PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #224
You are building a TensorFlow text-to-image generative model by using a dataset that contains billions of images with their respective captions. You want to create a low maintenance, automated workflo
The correct answer is D. Use the TensorFlow Extended (TFX) SDK to create multiple components that use Dataflow and. For an automated, low-maintenance ML workflow involving massive datasets, data processing, and TensorFlow model training/validation, TensorFlow Extended (TFX) SDK provides end-to-end components that integrate seamlessly with Dataflow.
Question
Options
- AUse the Apache Airflow SDK to create multiple operators that use Dataflow and Vertex AI
- BUse the MLFlow SDK and deploy it on a Google Kubernetes Engine cluster. Create multiple
- CUse the Kubeflow Pipelines (KFP) SDK to create multiple components that use Dataflow and
- DUse the TensorFlow Extended (TFX) SDK to create multiple components that use Dataflow and
How the community answered
(34 responses)- A6% (2)
- B9% (3)
- C3% (1)
- D82% (28)
Why each option
For an automated, low-maintenance ML workflow involving massive datasets, data processing, and TensorFlow model training/validation, TensorFlow Extended (TFX) SDK provides end-to-end components that integrate seamlessly with Dataflow.
Apache Airflow can orchestrate workflows but requires more manual setup and integration of individual components compared to the opinionated, TensorFlow-specific framework of TFX.
MLFlow focuses primarily on ML lifecycle management (experiment tracking, model packaging) but is not a full-fledged pipeline orchestration and component framework like TFX for end-to-end ML.
Kubeflow Pipelines (KFP) is a general ML orchestration platform, but for a TensorFlow-specific model and workflow, TFX often provides more out-of-the-box, optimized components and a more streamlined experience.
TensorFlow Extended (TFX) is specifically designed for building and managing ML pipelines, offering components for data ingestion, validation, transformation (often using Apache Beam/Dataflow), model training, evaluation, and deployment. It provides a robust, opinionated, and integrated solution for complex, large-scale TensorFlow workflows, ensuring automation and low maintenance.
Concept tested: End-to-end TensorFlow ML pipelines with TFX
Source: https://www.tensorflow.org/tfx/guide/understanding_tfx_pipelines
Topics
Community Discussion
No community discussion yet for this question.