nerdexam
Amazon

MLS-C01 · Question #348

A machine learning (ML) engineer uses Bayesian optimization for a hyperpara meter tuning job in Amazon SageMaker. The ML engineer uses precision as the objective metric. The ML engineer wants to use…

The correct answer is A. Use a warm start hyperparameter tuning job. To efficiently run a new SageMaker hyperparameter tuning job with expanded ranges or a changed objective, leverage previous job results.

ML Implementation and Operations

Question

A machine learning (ML) engineer uses Bayesian optimization for a hyperpara meter tuning job in Amazon SageMaker. The ML engineer uses precision as the objective metric. The ML engineer wants to use recall as the objective metric. The ML engineer also wants to expand the hyperparameter range for a new hyperparameter tuning job. The new hyperparameter range will include the range of the previously performed tuning job. Which approach will run the new hyperparameter tuning job in the LEAST amount of time?

Options

  • AUse a warm start hyperparameter tuning job.
  • BUse a checkpointing hyperparameter tuning job.
  • CUse the same random seed for the hyperparameter tuning job.
  • DUse multiple jobs in parallel for the hyperparameter tuning job.

How the community answered

(22 responses)
  • A
    73% (16)
  • B
    9% (2)
  • C
    5% (1)
  • D
    14% (3)

Why each option

To efficiently run a new SageMaker hyperparameter tuning job with expanded ranges or a changed objective, leverage previous job results.

AUse a warm start hyperparameter tuning job.Correct

Using a warm start hyperparameter tuning job allows SageMaker to incorporate the results from previous tuning jobs when exploring new hyperparameter ranges or optimizing a different objective. This enables the Bayesian optimization algorithm to leverage past knowledge, significantly reducing the number of trials needed to converge and thus minimizing the total tuning time.

BUse a checkpointing hyperparameter tuning job.

Checkpointing is used to resume a *single* long-running training job from its last saved state, not to speed up a *new* hyperparameter tuning job that has changed objectives or expanded ranges.

CUse the same random seed for the hyperparameter tuning job.

Using the same random seed ensures the reproducibility of random processes but does not reduce the actual computation time required to explore a new or expanded hyperparameter space for optimization.

DUse multiple jobs in parallel for the hyperparameter tuning job.

Using multiple jobs in parallel reduces the wall-clock time for a tuning job by running trials concurrently, but it does not inherently reduce the *total number of trials* or the overall computational effort required to find optimal hyperparameters for an expanded search space or new objective as effectively as a warm start.

Concept tested: SageMaker Hyperparameter Tuning Warm Start

Source: https://docs.aws.amazon.com/sagemaker/latest/dg/warm-start-tuning.html

Topics

#Hyperparameter Tuning#Amazon SageMaker#Warm Start#Bayesian Optimization

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice