MLS-C01 · Question #341
A data scientist is trying to improve the accuracy of a neural network classification model. The data scientist wants to run a large hyperparameter tuning job in Amazon SageMaker. However, previous…
The correct answer is A. Use the Hyperband tuning strategy. C. Set a lower value for the MaxNumberOfTrainingJobs parameter. To significantly reduce computation time for a large Amazon SageMaker hyperparameter tuning job, leverage efficient tuning strategies and limit the total number of evaluations.
Question
A data scientist is trying to improve the accuracy of a neural network classification model. The data scientist wants to run a large hyperparameter tuning job in Amazon SageMaker. However, previous smaller tuning jobs on the same model often ran for several weeks. The ML specialist wants to reduce the computation time required to run the tuning job. Which actions will MOST reduce the computation time for the hyperparameter tuning job? (Choose two.)
Options
- AUse the Hyperband tuning strategy.
- BIncrease the number of hyperparameters.
- CSet a lower value for the MaxNumberOfTrainingJobs parameter.
- DUse the grid search tuning strategy.
- ESet a lower value for the MaxParallelTrainingJobs parameter.
How the community answered
(53 responses)- A72% (38)
- B9% (5)
- D4% (2)
- E15% (8)
Why each option
To significantly reduce computation time for a large Amazon SageMaker hyperparameter tuning job, leverage efficient tuning strategies and limit the total number of evaluations.
The Hyperband tuning strategy is an advanced algorithm that efficiently allocates resources and prunes poorly performing hyperparameter configurations early, leading to faster convergence and reduced overall computation time compared to less efficient methods.
Increasing the number of hyperparameters would expand the search space, generally increasing the computation time needed for tuning, not reducing it.
The MaxNumberOfTrainingJobs parameter directly limits the total number of hyperparameter combinations that SageMaker will evaluate, thereby reducing the total computation required for the tuning job.
Grid search is an exhaustive tuning strategy that evaluates every specified combination, which is computationally expensive and typically slower than more advanced strategies like Hyperband for large search spaces.
The MaxParallelTrainingJobs parameter controls the number of concurrent training jobs; reducing this value would decrease parallelism and increase the total wall-clock time, not reduce the overall computation time.
Concept tested: SageMaker Hyperparameter Tuning Optimization
Source: https://docs.aws.amazon.com/sagemaker/latest/dg/automatic-model-tuning-how-it-works.html
Topics
Community Discussion
No community discussion yet for this question.