PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #266
You have recently used TensorFlow to train a classification model on tabular data. You have created a Dataflow pipeline that can transform several terabytes of data into training or prediction dataset
The correct answer is B. Import the model into Vertex AI and deploy it to a Vertex AI endpoint. Create a Dataflow pipeline. To productionize a TensorFlow model for weekly batch predictions uploaded to BigQuery, utilizing an existing Dataflow pipeline for transformation, deploy the model to Vertex AI and use a Dataflow pipeline for prediction.
Question
Options
- AImport the model into Vertex AI and deploy it to a Vertex AI endpoint. On Vertex AI Pipelines,
- BImport the model into Vertex AI and deploy it to a Vertex AI endpoint. Create a Dataflow pipeline
- CImport the model into Vertex AI. On Vertex AI Pipelines, create a pipeline that uses the
- DImport the model into BigQuery. Implement the data processing logic in a SQL query. On Vertex
How the community answered
(44 responses)- A14% (6)
- B77% (34)
- C2% (1)
- D7% (3)
Why each option
To productionize a TensorFlow model for weekly batch predictions uploaded to BigQuery, utilizing an existing Dataflow pipeline for transformation, deploy the model to Vertex AI and use a Dataflow pipeline for prediction.
While Vertex AI Pipelines can orchestrate batch predictions, reusing an existing Dataflow pipeline for transformation and prediction is generally more efficient and direct than reimplementing or wrapping it within a pipeline component if the Dataflow job is already robust.
Importing the model into Vertex AI and deploying it to an endpoint provides managed model serving. An existing Dataflow pipeline can then be orchestrated to perform batch predictions from the deployed model on a weekly schedule, leveraging its existing data transformation logic, and then writing the results directly to BigQuery.
Similar to A, using Vertex AI Pipelines for the entire process might be an option, but the question implies an existing Dataflow pipeline, making a direct Dataflow job for prediction a more straightforward and efficient path.
Importing a custom TensorFlow model directly into BigQuery ML is not the standard approach for external TensorFlow models, and reimplementing data processing in SQL would negate the existing Dataflow pipeline.
Concept tested: Batch prediction with Vertex AI and Dataflow
Source: https://cloud.google.com/dataflow/docs/guides/create-prediction-pipeline
Topics
Community Discussion
No community discussion yet for this question.