MLA-C01 · Question #15
A company has deployed an XGBoost prediction model in production to predict if a customer is likely to cancel a subscription. The company uses Amazon SageMaker Model Monitor to detect deviations in th
Sign in or unlock MLA-C01 to reveal the answer and full explanation for question #15. The question stem and answer options stay visible for context.
Question
A company has deployed an XGBoost prediction model in production to predict if a customer is likely to cancel a subscription. The company uses Amazon SageMaker Model Monitor to detect deviations in the F1 score. During a baseline analysis of model quality, the company recorded a threshold for the F1 score. After several months of no change, the model's F1 score decreases significantly. What could be the reason for the reduced F1 score?
Options
- AConcept drift occurred in the underlying customer data that was used for predictions.
- BThe model was not sufficiently complex to capture all the patterns in the original baseline data.
- CThe original baseline data had a data quality issue of missing values.
- DIncorrect ground truth labels were provided to Model Monitor during the calculation of the
Unlock MLA-C01 to see the answer
You've previewed enough free MLA-C01 questions. Unlock MLA-C01 for full answers, explanations, the timed quiz mode, progress tracking, and the master PDF. Question stem and options stay visible so you can still see what's on the exam.