PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #203
Your team has a model deployed to a Vertex AI endpoint. You have created a Vertex AI pipeline that automates the model training process and is triggered by a Cloud Function. You need to prioritize…
The correct answer is D. Enable model monitoring on the Vertex AI endpoint. Configure Pub/Sub to call the Cloud Function. To keep a Vertex AI model up-to-date while minimizing retraining costs, enable model monitoring to trigger retraining only when significant data or prediction drift, or feature attribution shift, is detected.
Question
Options
- AConfigure Pub/Sub to call the Cloud Function when a sufficient amount of new data becomes
- BConfigure a Cloud Scheduler job that calls the Cloud Function at a predetermined frequency that
- CEnable model monitoring on the Vertex AI endpoint. Configure Pub/Sub to call the Cloud Function
- DEnable model monitoring on the Vertex AI endpoint. Configure Pub/Sub to call the Cloud Function
How the community answered
(39 responses)- A5% (2)
- B10% (4)
- C3% (1)
- D82% (32)
Why each option
To keep a Vertex AI model up-to-date while minimizing retraining costs, enable model monitoring to trigger retraining only when significant data or prediction drift, or feature attribution shift, is detected.
Retraining based solely on a 'sufficient amount of new data' might lead to unnecessary retraining if the new data doesn't introduce significant changes, or might delay retraining if drift occurs before enough new data accumulates.
A fixed schedule from Cloud Scheduler might lead to retraining too frequently (high cost) when no drift has occurred, or too infrequently (stale model) when drift happens between scheduled runs.
While monitoring for a 'model quality threshold' is a valid approach, option D provides a more comprehensive set of drift triggers (data, prediction, and feature attribution shifts) that often serve as earlier and more direct indicators for initiating retraining to maintain model freshness and relevance.
Enabling Vertex AI Model Monitoring to detect data distribution shift, prediction distribution shift, or feature attribution shift provides robust signals for when a model is becoming stale. Configuring Pub/Sub to call the Cloud Function (and thus the retraining pipeline) only when such drift is detected ensures the model is retrained only when necessary, balancing freshness with cost minimization.
Concept tested: Vertex AI Model Monitoring for pipeline triggers
Source: https://cloud.google.com/vertex-ai/docs/model-monitoring/overview#alerts
Topics
Community Discussion
No community discussion yet for this question.