MLS-C01 · Question #348
A machine learning (ML) engineer uses Bayesian optimization for a hyperpara meter tuning job in Amazon SageMaker. The ML engineer uses precision as the objective metric. The ML engineer wants to use…
The correct answer is A. Use a warm start hyperparameter tuning job. To efficiently run a new SageMaker hyperparameter tuning job with expanded ranges or a changed objective, leverage previous job results.
Question
A machine learning (ML) engineer uses Bayesian optimization for a hyperpara meter tuning job in Amazon SageMaker. The ML engineer uses precision as the objective metric. The ML engineer wants to use recall as the objective metric. The ML engineer also wants to expand the hyperparameter range for a new hyperparameter tuning job. The new hyperparameter range will include the range of the previously performed tuning job. Which approach will run the new hyperparameter tuning job in the LEAST amount of time?
Options
- AUse a warm start hyperparameter tuning job.
- BUse a checkpointing hyperparameter tuning job.
- CUse the same random seed for the hyperparameter tuning job.
- DUse multiple jobs in parallel for the hyperparameter tuning job.
How the community answered
(22 responses)- A73% (16)
- B9% (2)
- C5% (1)
- D14% (3)
Why each option
To efficiently run a new SageMaker hyperparameter tuning job with expanded ranges or a changed objective, leverage previous job results.
Using a warm start hyperparameter tuning job allows SageMaker to incorporate the results from previous tuning jobs when exploring new hyperparameter ranges or optimizing a different objective. This enables the Bayesian optimization algorithm to leverage past knowledge, significantly reducing the number of trials needed to converge and thus minimizing the total tuning time.
Checkpointing is used to resume a *single* long-running training job from its last saved state, not to speed up a *new* hyperparameter tuning job that has changed objectives or expanded ranges.
Using the same random seed ensures the reproducibility of random processes but does not reduce the actual computation time required to explore a new or expanded hyperparameter space for optimization.
Using multiple jobs in parallel reduces the wall-clock time for a tuning job by running trials concurrently, but it does not inherently reduce the *total number of trials* or the overall computational effort required to find optimal hyperparameters for an expanded search space or new objective as effectively as a warm start.
Concept tested: SageMaker Hyperparameter Tuning Warm Start
Source: https://docs.aws.amazon.com/sagemaker/latest/dg/warm-start-tuning.html
Topics
Community Discussion
No community discussion yet for this question.