CTAL-TAE · Question #71
A suite of automated test cases was run multiple times on the same release of the SUT in the same test environment. Consider analyzing a test histogram that shows the distribution of test results…
The correct answer is C. Unstable automated test cases. A test histogram of results across multiple runs helps detect unstable (flaky) automated test cases, which sometimes pass and sometimes fail under the same conditions. This instability is clearly visible when analyzing result distributions over repeated executions.
Question
A suite of automated test cases was run multiple times on the same release of the SUT in the same test environment. Consider analyzing a test histogram that shows the distribution of test results (pass, fail, etc.) for each test case across these runs. Which of the following potential issues is MOST likely to be identified as a result of such an analysis?
Options
- AOutliers in test execution times
- BSecurity vulnerabilities in automated test cases
- CUnstable automated test cases
- DMaintainability issues in automated test cases
How the community answered
(33 responses)- A9% (3)
- B3% (1)
- C82% (27)
- D6% (2)
Explanation
A test histogram of results across multiple runs helps detect unstable (flaky) automated test cases, which sometimes pass and sometimes fail under the same conditions. This instability is clearly visible when analyzing result distributions over repeated executions.
Topics
Community Discussion
No community discussion yet for this question.