PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #284
You work for a rapidly growing social media company. Your team builds TensorFlow recommender models in an on-premises CPU cluster. The data contains billions of historical user events and 100,000 cate
The correct answer is A. Deploy the training jobs by using TPU VMs with TPUv3 Pod slices, and use the TPUEmbeading. To scale TensorFlow recommender model training with billions of user events and large categorical features on Google Cloud, use TPU VMs with TPUv3 Pod slices and TPUEmbedding for minimized training time.
Question
Options
- ADeploy the training jobs by using TPU VMs with TPUv3 Pod slices, and use the TPUEmbeading
- BDeploy the training jobs in an autoscaling Google Kubernetes Engine cluster with CPUs
- CDeploy a matrix factorization model training job by using BigQuery ML
- DDeploy the training jobs by using Compute Engine instances with A100 GPUs, and use the
How the community answered
(39 responses)- A82% (32)
- B3% (1)
- C10% (4)
- D5% (2)
Why each option
To scale TensorFlow recommender model training with billions of user events and large categorical features on Google Cloud, use TPU VMs with TPUv3 Pod slices and TPUEmbedding for minimized training time.
TPU VMs with TPUv3 Pod slices provide highly scalable and efficient computation for deep learning models, especially those with large embedding tables common in recommender systems. TPUEmbedding is specifically designed to handle large categorical features efficiently on TPUs, significantly reducing training time for such complex models.
An autoscaling Google Kubernetes Engine cluster with CPUs would not provide the specialized acceleration or scalability for deep learning models with large embeddings as effectively as TPUs or GPUs.
BigQuery ML's matrix factorization is a specific model type for collaborative filtering, not a general scalable training platform for existing complex TensorFlow recommender models with custom architectures and large embeddings.
While A100 GPUs are powerful, for models with extremely large embedding tables, TPUs combined with TPUEmbedding often offer superior performance and cost-efficiency due to their architecture being optimized for such workloads.
Concept tested: Scalable TensorFlow training with TPUs and embeddings
Source: https://cloud.google.com/vertex-ai/docs/training/using-tpus-embeddings
Topics
Community Discussion
No community discussion yet for this question.