PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #136
You manage a team of data scientists who use a cloud-based backend system to submit training jobs. This system has become very difficult to administer, and you want to use a managed service instead…
The correct answer is A. Use the Vertex AI Training to submit training jobs using any framework. To replace a difficult-to-administer cloud backend for ML training jobs with a managed service that supports various frameworks like Keras, PyTorch, and custom libraries, Vertex AI Training is the most suitable solution.
Question
Options
- AUse the Vertex AI Training to submit training jobs using any framework.
- BConfigure Kubeflow to run on Google Kubernetes Engine and submit training jobs through TFJob.
- CCreate a library of VM images on Compute Engine, and publish these images on a centralized
- DSet up Slurm workload manager to receive jobs that can be scheduled to run on your cloud
How the community answered
(45 responses)- A78% (35)
- B13% (6)
- C2% (1)
- D7% (3)
Why each option
To replace a difficult-to-administer cloud backend for ML training jobs with a managed service that supports various frameworks like Keras, PyTorch, and custom libraries, Vertex AI Training is the most suitable solution.
Vertex AI Training is a fully managed service that allows users to submit custom training jobs using virtually any ML framework, including Keras, PyTorch, scikit-learn, and custom libraries, typically via custom containers. This directly addresses the need for a managed solution that supports diverse frameworks without the administrative overhead of self-managed infrastructure.
While Kubeflow on Google Kubernetes Engine (GKE) provides powerful MLOps capabilities, it requires significant administrative effort to set up and maintain the GKE cluster and Kubeflow itself, contradicting the goal of moving away from a "difficult to administer" system.
Creating and managing a library of VM images on Compute Engine for different frameworks is a manual, unmanaged approach that increases administrative burden rather than reducing it, and does not offer a unified, managed job submission system.
Setting up Slurm workload manager introduces another layer of infrastructure management and administration, which goes against the requirement of transitioning to a managed service to simplify operations.
Concept tested: Google Cloud Vertex AI Training custom containers
Source: https://cloud.google.com/vertex-ai/docs/training/custom-containers
Topics
Community Discussion
No community discussion yet for this question.