nerdexam
iSQI

CTAL-TAE · Question #16

Your functional regression test automation suite ran successfully for the first two sprints and no failures were encountered during the runs. The automation suite records the status of each test…

The correct answer is A. a and b. Adding dynamic measurement information about the SUT (a) helps provide context and data to understand the state of the system at the time of failure, aiding in reproducing and diagnosing issues. Introducing a status of 'TAS error' (b) allows clear differentiation between test…

Reporting and Metrics

Question

Your functional regression test automation suite ran successfully for the first two sprints and no failures were encountered during the runs. The automation suite records the status of each test case as either ‘pass’ or ‘fail’ and has excellent recovery capability built in. For the third sprint, the TAS log reported several test cases with a status of ‘fail’. You investigated each test case and found that most failures were due to a defect in one of the keyword scripts, rather than in the SUT. For those where the failure was in the SUT, defect reports were raised but several were returned by the developers asking for more information to enable them to reproduce the problem. Which additional log items SHOULD you add to the TAS that would BEST improve failure analysis and defect reporting for future sprints?

Options

  • Aa and b.
  • Bd and e.
  • Ca and c.
  • Db and e.
  • ESystem configuration information including software/firmware and operating system versions.
  • FA copy of the source code for all Keyword scripts executed.

How the community answered

(26 responses)
  • A
    62% (16)
  • B
    19% (5)
  • C
    4% (1)
  • E
    12% (3)
  • F
    4% (1)

Explanation

Adding dynamic measurement information about the SUT (a) helps provide context and data to understand the state of the system at the time of failure, aiding in reproducing and diagnosing issues. Introducing a status of 'TAS error' (b) allows clear differentiation between test failures due to the automation system itself and those due to SUT defects, improving accuracy in failure analysis and defect reporting.

Topics

#defect reporting#false failures#test logs#automated test results

Community Discussion

No community discussion yet for this question.

Full CTAL-TAE Practice