PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #258
You built a deep learning-based image classification model by using on-premises data. You want to use Vertex AI to deploy the model to production. Due to security concerns, you cannot move your data t
The correct answer is D. Create a Vertex AI Model Monitoring job. Enable feature attribution skew and drift detection for. To detect model performance changes due to shifts in input data distribution, create a Vertex AI Model Monitoring job and enable feature attribution skew and drift detection.
Question
Options
- AUse Vertex Explainable AI for model explainability. Configure feature-based explanations.
- BUse Vertex Explainable AI for model explainability. Configure example-based explanations.
- CCreate a Vertex AI Model Monitoring job. Enable training-serving skew detection for your model.
- DCreate a Vertex AI Model Monitoring job. Enable feature attribution skew and drift detection for
How the community answered
(40 responses)- A13% (5)
- B18% (7)
- C5% (2)
- D65% (26)
Why each option
To detect model performance changes due to shifts in input data distribution, create a Vertex AI Model Monitoring job and enable feature attribution skew and drift detection.
Vertex Explainable AI provides insights into why a model made a specific prediction, but it doesn't automatically monitor for data skew or drift that leads to performance changes over time.
Similar to A, example-based explanations in Vertex Explainable AI help understand individual predictions but do not provide continuous monitoring for shifts in overall data distribution or model performance degradation.
While Vertex AI Model Monitoring can detect training-serving skew, the specific requirement for detecting 'input data distribution might change over time' is more directly addressed by feature drift detection, alongside skew, especially with feature attribution, for a more comprehensive understanding of performance shifts.
Vertex AI Model Monitoring allows you to detect data skew (differences between training and serving data) and data drift (changes in serving data over time), which are critical for identifying model performance degradation due to changing input data distribution. Enabling feature attribution skew and drift detection specifically helps understand if the importance of features is changing, providing deeper insights into model behavior shifts.
Concept tested: Vertex AI Model Monitoring for data drift and skew detection
Source: https://cloud.google.com/vertex-ai/docs/model-monitoring/overview
Topics
Community Discussion
No community discussion yet for this question.