PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #277
You work for an organization that operates a streaming music service. You have a custom production model that is serving a 搉ext song?recommendation based on a user's recent listening history. Your mod
The correct answer is C. Deploy the new model to the existing Vertex AI endpoint. Use traffic splitting to send 5% of. To safely test a retrained model in production with minimal complexity on a Vertex AI endpoint, deploy the new model to the existing endpoint and use traffic splitting to direct a small percentage of live requests to it.
Question
Options
- ACreate a new Vertex AI endpoint for the new model and deploy the new model to that new
- BCapture incoming prediction requests in BigQuery. Create an experiment in Vertex AI
- CDeploy the new model to the existing Vertex AI endpoint. Use traffic splitting to send 5% of
- DConfigure a model monitoring job for the existing Vertex AI endpoint. Configure the monitoring job
How the community answered
(56 responses)- A4% (2)
- B5% (3)
- C82% (46)
- D9% (5)
Why each option
To safely test a retrained model in production with minimal complexity on a Vertex AI endpoint, deploy the new model to the existing endpoint and use traffic splitting to direct a small percentage of live requests to it.
Creating a new Vertex AI endpoint for the new model would require updating the application logic to route traffic to the new endpoint, increasing complexity compared to using traffic splitting on an existing endpoint.
Capturing incoming prediction requests in BigQuery is a useful step for data logging and analysis, but it doesn't directly enable testing the new model in production with live traffic alongside the old model.
Deploying the new model to the existing Vertex AI endpoint and using traffic splitting is the recommended approach for safely testing a new model version in production with minimal complexity. This allows routing a small percentage of live traffic to the new model (canary deployment) to observe its real-world performance before a full rollout.
Configuring a model monitoring job is for observing a model's performance and detecting drift or anomalies after it has been deployed and is serving traffic, not for the initial testing and gradual rollout of a new model version.
Concept tested: Vertex AI Endpoint model versioning and traffic splitting
Source: https://cloud.google.com/vertex-ai/docs/predictions/deploy-model-traffic-split
Topics
Community Discussion
No community discussion yet for this question.