nerdexam
Amazon

MLS-C01 · Question #364

A machine learning (ML) engineer is using Amazon SageMaker automatic model tuning (AMT) to optimize a model's hyperparameters. The ML engineer notices that the tuning jobs take a long time to run…

The correct answer is D. Set TrainingJobEarlyStoppingType to the AUTO value. To optimize SageMaker automatic model tuning more quickly by stopping jobs that are not significantly improving against the objective metric, the ML engineer should configure TrainingJobEarlyStoppingType to AUTO.

Modeling

Question

A machine learning (ML) engineer is using Amazon SageMaker automatic model tuning (AMT) to optimize a model's hyperparameters. The ML engineer notices that the tuning jobs take a long time to run. The tuning jobs continue even when the jobs are not significantly improving against the objective metric. The ML engineer needs the training jobs to optimize the hyperparameters more quickly. How should the ML engineer configure the SageMaker AMT data types to meet these requirements?

Options

  • ASet Strategy to the Bayesian value.
  • BSet RetryStrategy to a value of 1.
  • CSet ParameterRanges to the narrow range Inferred from previous hyperparameter jobs.
  • DSet TrainingJobEarlyStoppingType to the AUTO value.

How the community answered

(21 responses)
  • A
    14% (3)
  • B
    5% (1)
  • C
    10% (2)
  • D
    71% (15)

Why each option

To optimize SageMaker automatic model tuning more quickly by stopping jobs that are not significantly improving against the objective metric, the ML engineer should configure `TrainingJobEarlyStoppingType` to `AUTO`.

ASet Strategy to the Bayesian value.

Setting the `Strategy` to `Bayesian` optimizes the selection of hyperparameter combinations across trials, making the overall tuning process more efficient, but it does not directly stop individual training jobs from running too long if they are not improving against the objective metric.

BSet RetryStrategy to a value of 1.

`RetryStrategy` configures the number of retries for failed training jobs within a hyperparameter tuning job and does not affect the duration of non-improving jobs.

CSet ParameterRanges to the narrow range Inferred from previous hyperparameter jobs.

Narrowing the `ParameterRanges` reduces the search space for hyperparameters, which can speed up the overall tuning process by exploring fewer combinations, but it does not specifically stop individual training jobs that are no longer improving against their objective metric.

DSet TrainingJobEarlyStoppingType to the AUTO value.Correct

Setting `TrainingJobEarlyStoppingType` to `AUTO` in SageMaker automatic model tuning enables SageMaker to automatically detect when a training job is unlikely to improve further based on the objective metric and stop it early. This directly addresses the problem of tuning jobs taking too long and continuing without significant improvement, thereby speeding up the hyperparameter optimization process.

Concept tested: SageMaker Hyperparameter Tuning early stopping

Source: https://docs.aws.amazon.com/sagemaker/latest/dg/automatic-model-tuning-early-stopping.html

Topics

#SageMaker AMT#Hyperparameter Optimization#Bayesian Optimization#ML Tuning Strategy

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice