Which option describes a reasonable application of AIB testing for a self-learning system after it has changed its behavior due to user input?

The correct answer is C. Comparing outputs before and after the change using identical inputs. According to Section4.6 - AI Behaviour Testing (AIB Testing)of the ISTQB CT-AI syllabus, AIB testing is used to evaluate changes in the functional behavior of self-learning systems. The core principle iscomparing pre-change and post-change model behavior using the same test…

Specific Approaches to Testing AI-based Systems

Question

Options

AGenerating test cases for the system before and after the change, since neither has a test oracle
BComparing outputs before and after the change using different inputs
CComparing outputs before and after the change using identical inputs
DComparing outputs of a non-self-learning system with those of the changed self-learning system

How the community answered

(27 responses)

A
4% (1)
B
7% (2)
C
70% (19)
D
19% (5)

Explanation

According to Section4.6 - AI Behaviour Testing (AIB Testing)of the ISTQB CT-AI syllabus, AIB testing is used to evaluate changes in the functional behavior of self-learning systems. The core principle iscomparing pre-change and post-change model behavior using the same test inputs, so that any difference in outputs can be attributed to the model's learning and not to differences in input data. This directly corresponds to Option C.

Topics

#AIB testing#self-learning systems#back-to-back testing#oracle problem

Community Discussion

No community discussion yet for this question.

Full CT-AI Practice