nerdexam
iSQI

CTAL-TAE · Question #98

A regression test suite consist of 500 test cases which are all executed manually. The business case for a pilot project is based on the adoption of test automation using a commercial tool that will…

The correct answer is D. The target defined for the business case seems difficult to hit ?it should be realistic. Option D is correct because the pilot project's actual results - 40% of tests automated with only a 60% execution time reduction - fall significantly short of the business case targets of 100% automation and 90% time reduction, revealing that the original targets were overly…

Transitioning Manual Testing to an Automated Environment

Question

A regression test suite consist of 500 test cases which are all executed manually. The business case for a pilot project is based on the adoption of test automation using a commercial tool that will reduce the execution time by a factor of 90% for 100% of the tests in the regression test suite. The pilot project lasted one month ( as planned) and you are currently its results. At the end of the pilot project, 40% of the regression tests have been automated and their execution time has been reduce by 60%. Which of the following statements is TRUE in this scenario?

Options

  • AThe duration of the pilot project was too short 璱t should last unit the success factors are
  • BThe target defined for the business case is too accurate 璱t should not be measureable
  • CThe project selected for the pilot is too critical 璱f should not be too critical or too trivial
  • DThe target defined for the business case seems difficult to hit ?it should be realistic

How the community answered

(43 responses)
  • A
    9% (4)
  • B
    21% (9)
  • C
    5% (2)
  • D
    65% (28)

Explanation

Option D is correct because the pilot project's actual results - 40% of tests automated with only a 60% execution time reduction - fall significantly short of the business case targets of 100% automation and 90% time reduction, revealing that the original targets were overly optimistic and not grounded in realistic expectations.

Why the distractors are wrong:

  • A is incorrect because the pilot lasted exactly as long as planned (one month), so duration is not the issue - the problem lies with the targets, not the timeline.
  • B is incorrect because measurability is actually a desirable quality for targets (following SMART criteria); the flaw is not that the target was measurable, but that it was unachievable.
  • C is incorrect because there is no information in the scenario to suggest the project's criticality was a problem - project criticality is a separate concern unrelated to the gap between targets and results.

Memory tip: Use the SMART acronym - targets in a business case must be Realistic. Whenever a pilot falls well short of its targets, the first question to ask is whether the goal was achievable in the first place, not whether the project ran long enough or was chosen correctly.

Topics

#pilot project#business case#automation ROI#success metrics

Community Discussion

No community discussion yet for this question.

Full CTAL-TAE Practice