PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #185
You developed a custom model by using Vertex AI to forecast the sales of your company's products based on historical transactional data. You anticipate changes in the feature distributions and the…
The correct answer is D. Use the features and the feature attributions for monitoring. Set a prediction-sampling-rate value. To detect anticipated feature and correlation drift for a high-volume prediction model while minimizing cost, monitor features and feature attributions with a low prediction sampling rate.
Question
Options
- AUse the features for monitoring. Set a monitoring-frequency value that is higher than the default.
- BUse the features for monitoring. Set a prediction-sampling-rate value that is closer to 1 than 0.
- CUse the features and the feature attributions for monitoring. Set a monitoring-frequency value that
- DUse the features and the feature attributions for monitoring. Set a prediction-sampling-rate value
How the community answered
(38 responses)- A3% (1)
- B13% (5)
- C5% (2)
- D79% (30)
Why each option
To detect anticipated feature and correlation drift for a high-volume prediction model while minimizing cost, monitor features and feature attributions with a low prediction sampling rate.
Setting a monitoring-frequency value that is higher than the default means more frequent checks, which would significantly increase monitoring costs, contradicting the goal of cost minimization.
Setting a prediction-sampling-rate value closer to 1 means monitoring a larger percentage of predictions, which would substantially increase the cost of the monitoring job.
While using features and feature attributions is robust for drift detection, setting a higher monitoring-frequency value would lead to increased costs, failing to meet the cost minimization requirement.
Using both features and feature attributions for monitoring provides comprehensive drift detection, especially when changes in feature correlations are anticipated. To minimize cost with a large volume of predictions, setting a low prediction-sampling-rate reduces the amount of data processed by the monitoring job, thus lowering expenses without sacrificing essential detection capabilities.
Concept tested: Vertex AI Model Monitoring, drift detection, feature attributions, cost optimization
Source: https://cloud.google.com/vertex-ai/docs/model-monitoring/configure-monitoring-jobs
Topics
Community Discussion
No community discussion yet for this question.