PROFESSIONAL-MACHINE-LEARNING-ENGINEER Question #326: Real Exam Question with Answer & Explanation

Question

You are building an ML pipeline to process and analyze both streaming and batch datasets. You need the pipeline to handle data validation, preprocessing, model training, and model deployment in a consistent and automated way. You want to design an efficient and scalable solution that captures model training metadata and is easily reproducible. You want to be able to reuse custom components for different parts of your pipeline. What should you do?

Options

• AUse Cloud Composer for distributed processing of batch and streaming data in the pipeline.
• BUse Dataflow for distributed processing of batch and streaming data in the pipeline.
• CUse Cloud Build to build and push Docker images for each pipeline component.
• DImplement an orchestration framework such as Kubeflow Pipelines or Vertex AI Pipelines.