nerdexam
ISTQB

CT-AI · Question #104

An airline has created a ML model to project fuel requirements for future flights. The model imports weather data such as wind speeds and temperatures, calculates flight routes based on historical…

The correct answer is A. The model suffers from drift and therefore should be regularly tested to ensure that any. The syllabus states: "Concept drift occurs when the operational environment changes without the trained model changing correspondingly. The outputs of the model become less accurate and less useful. Therefore, the operational model should be regularly evaluated against its…

Testing of AI-based Systems

Question

An airline has created a ML model to project fuel requirements for future flights. The model imports weather data such as wind speeds and temperatures, calculates flight routes based on historical routings from air traffic control, and estimates loads from average passenger and baggage weights. The model performed within an acceptable standard for the airline throughout the summer but as winter set in the load weights became less accurate. After some exploratory data analysis it became apparent that luggage weights were higher in the winter than in summer. Which of the following statements BEST describes the problem and how it could have been prevented?

Options

  • AThe model suffers from drift and therefore should be regularly tested to ensure that any
  • BThe model suffers from drift and therefore the performance standard should be eased until a new
  • CThe model suffers from corruption and therefore should be reloaded into the computer system
  • DThe model suffers from a lack of transparency and therefore should be regularly tested to ensure

How the community answered

(28 responses)
  • A
    79% (22)
  • B
    11% (3)
  • C
    4% (1)
  • D
    7% (2)

Explanation

The syllabus states: "Concept drift occurs when the operational environment changes without the trained model changing correspondingly. The outputs of the model become less accurate and less useful. Therefore, the operational model should be regularly evaluated against its acceptance criteria."

Topics

#model drift#data drift#seasonal variation#model monitoring

Community Discussion

No community discussion yet for this question.

Full CT-AI Practice