nerdexam
Google

PROFESSIONAL-MACHINE-LEARNING-ENGINEER · Question #183

You created an ML pipeline with multiple input parameters. You want to investigate the tradeoffs between different parameter combinations. The parameter options are: - Input dataset - Max tree depth…

The correct answer is D. 1. Create an experiment in Vertex AI Experiments. To investigate tradeoffs between various ML pipeline parameter combinations, track performance metrics, and ensure reproducibility, utilize Vertex AI Experiments.

Submitted by hassan_iq· Apr 18, 2026Monitoring, optimizing, and maintaining ML solutions

Question

You created an ML pipeline with multiple input parameters. You want to investigate the tradeoffs between different parameter combinations. The parameter options are: - Input dataset - Max tree depth of the boosted tree regressor - Optimizer learning rate You need to compare the pipeline performance of the different parameter combinations measured in F1 score, time to train, and model complexity. You want your approach to be reproducible, and track all pipeline runs on the same platform. What should you do?

Options

  • A
    1. Use BigQueryML to create a boosted tree regressor, and use the hyperparameter tuning
  • B
    1. Create a Vertex AI pipeline with a custom model training job as part of the pipeline. Configure
  • C
    1. Create a Vertex AI Workbench notebook for each of the different input datasets.
  • D
    1. Create an experiment in Vertex AI Experiments.

How the community answered

(26 responses)
  • A
    15% (4)
  • B
    4% (1)
  • C
    4% (1)
  • D
    77% (20)

Why each option

To investigate tradeoffs between various ML pipeline parameter combinations, track performance metrics, and ensure reproducibility, utilize Vertex AI Experiments.

A1. Use BigQueryML to create a boosted tree regressor, and use the hyperparameter tuning

BigQuery ML's hyperparameter tuning is limited to optimizing parameters within BQML models and does not support tracking custom pipeline steps, varying input datasets, or broader metrics across a general ML pipeline.

B1. Create a Vertex AI pipeline with a custom model training job as part of the pipeline. Configure

A Vertex AI pipeline orchestrates steps but does not inherently provide the experiment tracking and comparison features needed to investigate tradeoffs across different parameter combinations in an organized manner; you'd still need an experiment management layer.

C1. Create a Vertex AI Workbench notebook for each of the different input datasets.

Using Vertex AI Workbench notebooks for each dataset is a manual and unmanaged approach that lacks the structured tracking, comparison, and reproducibility features required for robust experimentation across multiple parameter combinations.

D1. Create an experiment in Vertex AI Experiments.Correct

Vertex AI Experiments is specifically designed to manage and track multiple runs of ML pipelines or training jobs, allowing users to compare different parameter combinations (including datasets and hyperparameters), log custom metrics (F1 score, training time, model complexity), and maintain reproducibility on a centralized platform.

Concept tested: Vertex AI Experiments, experiment tracking, MLOps

Source: https://cloud.google.com/vertex-ai/docs/experiments/introduction-vertex-ai-experiments

Topics

#Experiment tracking#Hyperparameter tuning#MLOps#Vertex AI

Community Discussion

No community discussion yet for this question.

Sign up to join the discussion
Full PROFESSIONAL-MACHINE-LEARNING-ENGINEER Practice