nerdexam
Microsoft

DP-100 · Question #424

You create an Azure Machine Learning workspace. You are implementing hyperparameter tuning for a model training from a notebook. You must configure a Bandit termination policy that provides the…

The correct answer is C. Set slack_factor to 0.2. The Bandit early termination policy terminates runs whose primary metric falls below a threshold derived from the best run so far. With slack_factor, the termination threshold is calculated as: best_metric / (1 + slack_factor). Plugging in slack_factor = 0.2: 0.8 / (1 + 0.2) =…

Explore data and run experiments

Question

You create an Azure Machine Learning workspace. You are implementing hyperparameter tuning for a model training from a notebook. You must configure a Bandit termination policy that provides the following outcome: If the value of the primary metric of AUC is 0.8 at the point of evaluation intervals, any run with the primary metric value below 0.66 will be terminated. You need to identify which Bandit termination policy configuration to use. What should you identify?

Options

  • ASet slack_amount to 0.2.
  • BSet slack_factor to 0.1.
  • CSet slack_factor to 0.2.
  • DSet slack_amount to 0.1.

How the community answered

(27 responses)
  • A
    15% (4)
  • B
    4% (1)
  • C
    70% (19)
  • D
    11% (3)

Explanation

The Bandit early termination policy terminates runs whose primary metric falls below a threshold derived from the best run so far. With slack_factor, the termination threshold is calculated as: best_metric / (1 + slack_factor). Plugging in slack_factor = 0.2: 0.8 / (1 + 0.2) = 0.8 / 1.2 ≈ 0.667, which matches the required cutoff of 0.66. With slack_amount, the threshold is best_metric − slack_amount, so slack_amount = 0.2 gives 0.8 − 0.2 = 0.6 (too low), and slack_amount = 0.1 gives 0.8 − 0.1 = 0.7 (too high). Only slack_factor = 0.2 produces the correct ~0.66 threshold.

Topics

#Hyperparameter Tuning#Early Termination Policy#Azure Machine Learning#Bandit Policy

Community Discussion

No community discussion yet for this question.

Full DP-100 Practice