PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #201
You recently deployed a model to a Vertex AI endpoint. Your data drifts frequently, so you have enabled request-response logging and created a Vertex AI Model Monitoring job. You have observed that…
The correct answer is C. Decrease the sample_rate parameter in the RandomSampleConfig of the monitoring job. To reduce Vertex AI Model Monitoring costs while maintaining quick drift detection for a frequently drifting model, decrease the sampling rate of the monitoring job.
Question
Options
- AReplace the monitoring job with a DataFlow pipeline that uses TensorFlow Data Validation
- BReplace the monitoring job with a custom SQL script to calculate statistics on the features and
- CDecrease the sample_rate parameter in the RandomSampleConfig of the monitoring job
- DIncrease the monitor_interval parameter in the ScheduleConfig of the monitoring job
How the community answered
(43 responses)- A2% (1)
- B7% (3)
- C74% (32)
- D16% (7)
Why each option
To reduce Vertex AI Model Monitoring costs while maintaining quick drift detection for a frequently drifting model, decrease the sampling rate of the monitoring job.
Replacing the monitoring job with a custom Dataflow pipeline would involve significant development and maintenance overhead, likely increasing overall cost and effort compared to adjusting an existing monitoring job parameter.
Replacing the monitoring job with a custom SQL script is a manual and less automated approach for drift detection, which could be less efficient and more costly to maintain than using Vertex AI Model Monitoring.
Decreasing the sample_rate parameter in the RandomSampleConfig of the monitoring job reduces the percentage of prediction requests and responses that are analyzed by Vertex AI Model Monitoring. This directly lowers the processing cost by reducing the amount of data processed while still allowing the monitoring job to run frequently enough to quickly detect drift.
Increasing the monitor_interval parameter would reduce the frequency of monitoring checks, directly slowing down the detection of data drift, which contradicts the requirement to 'quickly detect drift'.
Concept tested: Vertex AI Model Monitoring cost optimization
Source: https://cloud.google.com/vertex-ai/docs/model-monitoring/overview#cost
Topics
Community Discussion
No community discussion yet for this question.