PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #251
You work at a mobile gaming startup that creates online multiplayer games. Recently, your company observed an increase in players cheating in the games, leading to a loss of revenue and a poor user…
The correct answer is D. Import the model into Vertex AI Model Registry. Create a Vertex AI endpoint that hosts the model. To provide immediate, low-latency classifications for a trained model in production, the model should be imported into Vertex AI Model Registry and deployed to a Vertex AI endpoint for online prediction.
Question
Options
- AImport the model into Vertex AI Model Registry. Use the Vertex Batch Prediction service to run
- BSave the model files in a Cloud Storage bucket. Create a Cloud Function to read the model files
- CSave the model files in a VM. Load the model files each time there is a prediction request, and
- DImport the model into Vertex AI Model Registry. Create a Vertex AI endpoint that hosts the model,
How the community answered
(18 responses)- A6% (1)
- B6% (1)
- C11% (2)
- D78% (14)
Why each option
To provide immediate, low-latency classifications for a trained model in production, the model should be imported into Vertex AI Model Registry and deployed to a Vertex AI endpoint for online prediction.
Vertex Batch Prediction is designed for high-throughput, asynchronous predictions on large datasets, not for immediate, low-latency, real-time classifications.
While Cloud Functions can serve models, directly loading model files from Cloud Storage for each request can introduce higher latency and isn't as optimized or scalable for real-time serving as a dedicated Vertex AI endpoint.
Saving model files in a VM and loading them per request is a manual, unmanaged approach that lacks scalability, high availability, and the managed features of Vertex AI for production model serving.
Importing the model into Vertex AI Model Registry centralizes model management. Creating a Vertex AI endpoint to host the model enables online predictions, which are suitable for immediate, low-latency classifications required after a completed game session. This setup allows for real-time inference and integrates well with downstream systems for actions like banning players.
Concept tested: Vertex AI online prediction for low-latency inference
Source: https://cloud.google.com/vertex-ai/docs/predictions/online-predictions
Topics
Community Discussion
No community discussion yet for this question.