MLS-C01 · Question #371
A machine learning (ML) engineer is creating a binary classification model. The ML engineer will use the model in a highly sensitive environment. There is no cost associated with missing a positive…
The correct answer is B. Precision. To optimize a binary classification model where false positives are extremely costly and false negatives have no cost, the most critical metric to optimize is Precision.
Question
A machine learning (ML) engineer is creating a binary classification model. The ML engineer will use the model in a highly sensitive environment. There is no cost associated with missing a positive label. However, the cost of making a false positive inference is extremely high. What is the most important metric to optimize the model for in this scenario?
Options
- AAccuracy
- BPrecision
- CRecall
- DF1
How the community answered
(17 responses)- A6% (1)
- B82% (14)
- C12% (2)
Why each option
To optimize a binary classification model where false positives are extremely costly and false negatives have no cost, the most critical metric to optimize is Precision.
Accuracy provides an overall measure of correctness but does not specifically address the unequal costs of false positives versus false negatives, making it unsuitable for this sensitive scenario.
Precision measures the proportion of positive identifications that were actually correct (True Positives / (True Positives + False Positives)). By optimizing for Precision, the model prioritizes minimizing false positive inferences, which aligns directly with the scenario's requirement to avoid the extremely high cost associated with them.
Recall measures the proportion of actual positive cases that were correctly identified, focusing on minimizing false negatives, which is explicitly stated as having no associated cost in this scenario.
The F1 score is the harmonic mean of Precision and Recall, aiming to balance both, which is not ideal when one type of error (false positives) is significantly more costly than the other.
Concept tested: Classification model evaluation metrics - Precision
Source: https://docs.aws.amazon.com/sagemaker/latest/dg/cdf-model-metrics.html
Topics
Community Discussion
No community discussion yet for this question.