CTAL-TAE · Question #26
You have executed an automated test suite for a product that was released into production. Although all the tests passed, there was a major failure in production in an area that was covered well by…
The correct answer is A. Remove the intermittently failing test from the test suite and investigate the reason why the test. The correct action is to investigate the intermittently failing test to determine why it sometimes passes and sometimes fails. Intermittent behavior suggests instability in the test or the SUT, which undermines trust in the automation results. Removing the test without…
Question
You have executed an automated test suite for a product that was released into production. Although all the tests passed, there was a major failure in production in an area that was covered well by your automated tests. You have run the automated tests again and one of the tests is now failing and this is directly related to the production defect that was raised. You decide to run the automated test suite again on the same version of the SUT and the test now passes. What SHOULD you do now to verify the validity of the automated tests?
Options
- ARemove the intermittently failing test from the test suite and investigate the reason why the test
- BCheck that the production defect that was reported was an actual defect.
- CRun the automated test suite again and if the test now passes - do nothing.
- DRemove the intermittently failing test from the test suite and re-run the automated test suite again.
How the community answered
(54 responses)- A67% (36)
- B9% (5)
- C6% (3)
- D19% (10)
Explanation
The correct action is to investigate the intermittently failing test to determine why it sometimes passes and sometimes fails. Intermittent behavior suggests instability in the test or the SUT, which undermines trust in the automation results. Removing the test without understanding the cause would be premature and risky.
Topics
Community Discussion
No community discussion yet for this question.