nerdexam
Amazon

MLS-C01 · Question #342

A machine learning (ML) specialist needs to solve a binary classification problem for a marketing dataset. The ML specialist must maximize the Area Under the ROC Curve (AUC) of the algorithm by…

The correct answer is C. Use Amazon SageMaker automatic model tuning (AMT). Specify a range of values for each. To maximize AUC for an XGBoost binary classification model by tuning hyperparameters with the least operational overhead, utilize Amazon SageMaker's managed tuning capabilities.

ML Implementation and Operations

Question

A machine learning (ML) specialist needs to solve a binary classification problem for a marketing dataset. The ML specialist must maximize the Area Under the ROC Curve (AUC) of the algorithm by training an XGBoost algorithm. The ML specialist must find values for the eta, alpha, min_child_weight, and max_depth hyperparameters that will generate the most accurate model. Which approach will meet these requirements with the LEAST operational overhead?

Options

  • AUse a bootstrap script to install scikit-learn on an Amazon EMR cluster. Deploy the EMR cluster.
  • BDeploy Amazon SageMaker prebuilt Docker images that have scikit-learn installed. Apply k-fold
  • CUse Amazon SageMaker automatic model tuning (AMT). Specify a range of values for each
  • DSubscribe to an AUC algorithm that is on AWS Marketplace. Specify a range of values for each

How the community answered

(51 responses)
  • A
    4% (2)
  • B
    14% (7)
  • C
    76% (39)
  • D
    6% (3)

Why each option

To maximize AUC for an XGBoost binary classification model by tuning hyperparameters with the least operational overhead, utilize Amazon SageMaker's managed tuning capabilities.

AUse a bootstrap script to install scikit-learn on an Amazon EMR cluster. Deploy the EMR cluster.

Using a bootstrap script on an Amazon EMR cluster to install scikit-learn and run tuning involves significant manual setup, cluster management, and custom script development, leading to high operational overhead.

BDeploy Amazon SageMaker prebuilt Docker images that have scikit-learn installed. Apply k-fold

Deploying SageMaker prebuilt Docker images with scikit-learn still requires manual orchestration of the hyperparameter tuning process, including implementing k-fold cross-validation and search strategies, which increases development and operational effort compared to AMT.

CUse Amazon SageMaker automatic model tuning (AMT). Specify a range of values for eachCorrect

Amazon SageMaker automatic model tuning (AMT) provides a fully managed service that uses intelligent search strategies, such as Bayesian optimization, to efficiently find optimal hyperparameter values within specified ranges, minimizing operational overhead while maximizing a defined objective metric like AUC.

DSubscribe to an AUC algorithm that is on AWS Marketplace. Specify a range of values for each

Subscribing to an algorithm on AWS Marketplace and specifying ranges would still likely require manual orchestration of the tuning process or reliance on a less explicit tuning mechanism, not directly offering the lowest operational overhead for comprehensive hyperparameter optimization compared to SageMaker AMT.

Concept tested: SageMaker Automatic Model Tuning (AMT)

Source: https://docs.aws.amazon.com/sagemaker/latest/dg/automatic-model-tuning.html

Topics

#Hyperparameter Tuning#Amazon SageMaker#XGBoost#Operational Efficiency

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice