PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #193
You are deploying a new version of a model to a production Vertex Al endpoint that is serving traffic. You plan to direct all user traffic to the new model. You need to deploy the model with minimal d
The correct answer is C. 1. Create a new model. Set the parentModel parameter to the model ID of the currently deployed. To deploy a new version of a model to a production Vertex AI endpoint with minimal disruption, upload the new model to the same model resource and use traffic splitting to gradually shift traffic.
Question
Options
- A
- Create a new endpoint
- B
- Create a new endpoint
- C
- Create a new model. Set the parentModel parameter to the model ID of the currently deployed
- D
- Create a new model. Set it as the default version. Upload the model to Vertex AI Model
How the community answered
(42 responses)- A10% (4)
- B5% (2)
- C83% (35)
- D2% (1)
Why each option
To deploy a new version of a model to a production Vertex AI endpoint with minimal disruption, upload the new model to the same model resource and use traffic splitting to gradually shift traffic.
Creating an entirely new endpoint and updating applications would cause disruption and downtime during the switch, which goes against the requirement of minimal disruption.
Creating an entirely new endpoint and updating applications would cause disruption and downtime during the switch, which goes against the requirement of minimal disruption.
The optimal approach to deploy a new model version with minimal disruption is to upload the new model to the same model resource, then deploy this new model alongside the existing one on the endpoint and manage traffic splitting to ensure a smooth transition without downtime.
Setting a new model as the 'default version' is not the standard Vertex AI Model Registry concept for managing live endpoint traffic splitting; managing versions and traffic occurs at the endpoint deployment level.
Concept tested: Vertex AI Endpoint model versioning and traffic splitting
Source: https://cloud.google.com/vertex-ai/docs/predictions/deploy-model-api#update_a_deployed_model
Topics
Community Discussion
No community discussion yet for this question.