CT-AI Question #13: Real Exam Question with Answer & Explanation

The correct answer is C. A comparison of the performance of an ML system on two different input datasets.. Option C describes comparing the performance of an ML system on two different input datasets. This scenario focuses on the input data variation rather than the comparison of system versions or features, which is the essence of A/B testing. A/B testing typically involves a control

Question

Which ONE of the following options describes a scenario of A/B testing the LEAST?

Options

AA comparison of two different websites for the same company to observe from a user acceptance
BA comparison of two different offers in a recommendation system to decide on the more effective
CA comparison of the performance of an ML system on two different input datasets.
DA comparison of the performance of two different ML implementations on the same input data.

Explanation

Option C describes comparing the performance of an ML system on two different input datasets. This scenario focuses on the input data variation rather than the comparison of system versions or features, which is the essence of A/B testing. A/B testing typically involves a controlled experiment with two versions being tested under the same conditions, not different datasets.

Community Discussion

No community discussion yet for this question.

Full CT-AI Practice