MLS-C01 · Question #364
A machine learning (ML) engineer is using Amazon SageMaker automatic model tuning (AMT) to optimize a model's hyperparameters. The ML engineer notices that the tuning jobs take a long time to run…
The correct answer is D. Set TrainingJobEarlyStoppingType to the AUTO value. To optimize SageMaker automatic model tuning more quickly by stopping jobs that are not significantly improving against the objective metric, the ML engineer should configure TrainingJobEarlyStoppingType to AUTO.
Question
A machine learning (ML) engineer is using Amazon SageMaker automatic model tuning (AMT) to optimize a model's hyperparameters. The ML engineer notices that the tuning jobs take a long time to run. The tuning jobs continue even when the jobs are not significantly improving against the objective metric. The ML engineer needs the training jobs to optimize the hyperparameters more quickly. How should the ML engineer configure the SageMaker AMT data types to meet these requirements?
Options
- ASet Strategy to the Bayesian value.
- BSet RetryStrategy to a value of 1.
- CSet ParameterRanges to the narrow range Inferred from previous hyperparameter jobs.
- DSet TrainingJobEarlyStoppingType to the AUTO value.
How the community answered
(21 responses)- A14% (3)
- B5% (1)
- C10% (2)
- D71% (15)
Why each option
To optimize SageMaker automatic model tuning more quickly by stopping jobs that are not significantly improving against the objective metric, the ML engineer should configure `TrainingJobEarlyStoppingType` to `AUTO`.
Setting the `Strategy` to `Bayesian` optimizes the selection of hyperparameter combinations across trials, making the overall tuning process more efficient, but it does not directly stop individual training jobs from running too long if they are not improving against the objective metric.
`RetryStrategy` configures the number of retries for failed training jobs within a hyperparameter tuning job and does not affect the duration of non-improving jobs.
Narrowing the `ParameterRanges` reduces the search space for hyperparameters, which can speed up the overall tuning process by exploring fewer combinations, but it does not specifically stop individual training jobs that are no longer improving against their objective metric.
Setting `TrainingJobEarlyStoppingType` to `AUTO` in SageMaker automatic model tuning enables SageMaker to automatically detect when a training job is unlikely to improve further based on the objective metric and stop it early. This directly addresses the problem of tuning jobs taking too long and continuing without significant improvement, thereby speeding up the hyperparameter optimization process.
Concept tested: SageMaker Hyperparameter Tuning early stopping
Source: https://docs.aws.amazon.com/sagemaker/latest/dg/automatic-model-tuning-early-stopping.html
Topics
Community Discussion
No community discussion yet for this question.