nerdexam
Google

PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #162

While running a model training pipeline on Vertex Al, you discover that the evaluation step is failing because of an out-of-memory error. You are currently using TensorFlow Model Analysis (TFMA)…

The correct answer is A. Include the flag -runner=DataflowRunner in beam_pipeline_args to run the evaluation step on. The evaluation step runs as an Apache Beam pipeline under the hood (TFMA uses Beam). Out-of-memory errors occur because the default runner (DirectRunner) processes everything on a single machine. Option D (limiting metrics) reduces evaluation quality, violating the requirement…

Submitted by packet_pusher· Apr 18, 2026ML pipeline operationalization

Question

While running a model training pipeline on Vertex Al, you discover that the evaluation step is failing because of an out-of-memory error. You are currently using TensorFlow Model Analysis (TFMA) with a standard Evaluator TensorFlow Extended (TFX) pipeline component for the evaluation step. You want to stabilize the pipeline without downgrading the evaluation quality while minimizing infrastructure overhead. What should you do?

Options

  • AInclude the flag -runner=DataflowRunner in beam_pipeline_args to run the evaluation step on
  • BMove the evaluation step out of your pipeline and run it on custom Compute Engine VMs with
  • CMigrate your pipeline to Kubeflow hosted on Google Kubernetes Engine, and specify the
  • DAdd tfma.MetricsSpec () to limit the number of metrics in the evaluation step.

How the community answered

(32 responses)
  • A
    75% (24)
  • B
    13% (4)
  • C
    9% (3)
  • D
    3% (1)

Explanation

The evaluation step runs as an Apache Beam pipeline under the hood (TFMA uses Beam). Out-of-memory errors occur because the default runner (DirectRunner) processes everything on a single machine. Option D (limiting metrics) reduces evaluation quality, violating the requirement. Options B and C both introduce significant infrastructure overhead (custom VMs and GKE cluster management, respectively). Option A is correct: adding '--runner=DataflowRunner' to beam_pipeline_args redirects the evaluation Beam pipeline to Google Cloud Dataflow, which automatically distributes the workload across managed workers, resolving memory pressure with no manual infrastructure management.

Topics

#TFX#Vertex AI#Dataflow#Pipeline Scaling

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-MACHINE-LEARNING-ENGINEER Practice