Unit Testing: How to treat errors as failures

2 visualizaciones (últimos 30 días)
Christian Heigele
Christian Heigele el 24 de En. de 2017
Comentada: Andy Campbell el 24 de En. de 2017
Whenever one of my functions throws an error that was not intended in that test-case the whole test suite stops. Is there any possibility to treat those error-occurrences as failures for those specific testcases and then continue with the next ones?
  1 comentario
Andy Campbell
Andy Campbell el 24 de En. de 2017
Hi Christian,
What test framework are you using? The framework that is officially included in MATLAB actually has the behavior you desire, unless something else is going on. Are you using the framework in the matlab.unittest package?
Andy

Iniciar sesión para comentar.

Respuestas (2)

KSSV
KSSV el 24 de En. de 2017
Read about try and catch
  2 comentarios
Christian Heigele
Christian Heigele el 24 de En. de 2017
Since those functions are executed by the test runner, I could only surround the testRunner call with a try / catch statement, which doesn't help me to continue with the rest of test-cases within the loaded test suite.
Hence I don't think this is a valid solution.
% This suite consists out of a few hundred test-cases, of which a few might throw an error.
suite= TestSuite.fromFolder('../..', 'IncludingSubfolders', true);
runner = TestRunner.withNoPlugins();
results = runner.run(suite); % This call should continue executing all testcases within the suite, even if one of them has thrown an error.
display(results);
Christian Heigele
Christian Heigele el 24 de En. de 2017
And of course I don't want to try/catch and omit the error inside of those functions, because the errors themselves are completely valid and helpful.

Iniciar sesión para comentar.


Adam
Adam el 24 de En. de 2017
doc matlab.unittest.qualifications.Assumable
rather than using assert in a unit test will cause the test to be filtered rather than produce a failure. In this case the test suite should continue rather than terminate.
Be careful not to squash expected errors with this though.

Categorías

Más información sobre Run Unit Tests en Help Center y File Exchange.

Etiquetas

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by