nerdexam
Isaca

AAIA · Question #52

When utilizing a machine learning (ML) model to predict whether a wind turbine electricity generator will fail, which model evaluation metric should be the PRIMARY focus?

The correct answer is D. Recall. For predicting wind turbine failures, recall is the most important metric because the cost of missing an actual failure (false negative) - a turbine breakdown - far outweighs the cost of a false alarm (false positive). High recall ensures that true failures are not overlooked.

AI Risk Management and Controls

Question

When utilizing a machine learning (ML) model to predict whether a wind turbine electricity generator will fail, which model evaluation metric should be the PRIMARY focus?

Options

  • APrecision
  • BSpecificity
  • CAccuracy
  • DRecall

How the community answered

(42 responses)
  • A
    5% (2)
  • B
    26% (11)
  • C
    14% (6)
  • D
    55% (23)

Why each option

For predicting wind turbine failures, recall is the most important metric because the cost of missing an actual failure (false negative) - a turbine breakdown - far outweighs the cost of a false alarm (false positive). High recall ensures that true failures are not overlooked.

APrecision

Precision measures the proportion of predicted failures that are actual failures; optimizing precision reduces false alarms but risks missing real failures, which is the more dangerous outcome in this scenario.

BSpecificity

Specificity measures the true negative rate - correctly identifying non-failure cases - which is not the primary concern when the goal is to catch all actual failures.

CAccuracy

Accuracy can be misleading for rare-event prediction like equipment failures because a model that always predicts 'no failure' may achieve high accuracy while completely failing to identify any real failures.

DRecallCorrect

Recall measures the proportion of actual positive cases (real failures) that the model correctly identifies, minimizing false negatives. In a failure prediction context, a false negative means a failure is not predicted and no preventive action is taken, potentially resulting in catastrophic equipment damage, safety hazards, and costly unplanned downtime. Because the consequence of missing a real failure is far more severe than acting on a false alarm, maximizing recall is the primary objective for this type of predictive maintenance model.

Concept tested: ML evaluation metric selection for failure prediction - recall vs. precision

Source: https://learn.microsoft.com/en-us/azure/machine-learning/component-reference/evaluate-model

Topics

#Machine Learning Metrics#Model Evaluation#False Negatives#Predictive Maintenance

Community Discussion

No community discussion yet for this question.

Full AAIA Practice