nerdexam
Amazon

MLS-C01 · Question #341

A data scientist is trying to improve the accuracy of a neural network classification model. The data scientist wants to run a large hyperparameter tuning job in Amazon SageMaker. However, previous…

The correct answer is A. Use the Hyperband tuning strategy. C. Set a lower value for the MaxNumberOfTrainingJobs parameter. To significantly reduce computation time for a large Amazon SageMaker hyperparameter tuning job, leverage efficient tuning strategies and limit the total number of evaluations.

ML Implementation and Operations

Question

A data scientist is trying to improve the accuracy of a neural network classification model. The data scientist wants to run a large hyperparameter tuning job in Amazon SageMaker. However, previous smaller tuning jobs on the same model often ran for several weeks. The ML specialist wants to reduce the computation time required to run the tuning job. Which actions will MOST reduce the computation time for the hyperparameter tuning job? (Choose two.)

Options

  • AUse the Hyperband tuning strategy.
  • BIncrease the number of hyperparameters.
  • CSet a lower value for the MaxNumberOfTrainingJobs parameter.
  • DUse the grid search tuning strategy.
  • ESet a lower value for the MaxParallelTrainingJobs parameter.

How the community answered

(53 responses)
  • A
    72% (38)
  • B
    9% (5)
  • D
    4% (2)
  • E
    15% (8)

Why each option

To significantly reduce computation time for a large Amazon SageMaker hyperparameter tuning job, leverage efficient tuning strategies and limit the total number of evaluations.

AUse the Hyperband tuning strategy.Correct

The Hyperband tuning strategy is an advanced algorithm that efficiently allocates resources and prunes poorly performing hyperparameter configurations early, leading to faster convergence and reduced overall computation time compared to less efficient methods.

BIncrease the number of hyperparameters.

Increasing the number of hyperparameters would expand the search space, generally increasing the computation time needed for tuning, not reducing it.

CSet a lower value for the MaxNumberOfTrainingJobs parameter.Correct

The MaxNumberOfTrainingJobs parameter directly limits the total number of hyperparameter combinations that SageMaker will evaluate, thereby reducing the total computation required for the tuning job.

DUse the grid search tuning strategy.

Grid search is an exhaustive tuning strategy that evaluates every specified combination, which is computationally expensive and typically slower than more advanced strategies like Hyperband for large search spaces.

ESet a lower value for the MaxParallelTrainingJobs parameter.

The MaxParallelTrainingJobs parameter controls the number of concurrent training jobs; reducing this value would decrease parallelism and increase the total wall-clock time, not reduce the overall computation time.

Concept tested: SageMaker Hyperparameter Tuning Optimization

Source: https://docs.aws.amazon.com/sagemaker/latest/dg/automatic-model-tuning-how-it-works.html

Topics

#Hyperparameter Tuning#SageMaker Hyperparameter Tuning#Hyperband#Resource Optimization

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice