nerdexam
Amazon

MLS-C01 · Question #239

A bank wants to use a machine learning (ML) model to predict if users will default on credit card payments. The training data consists of 30,000 labeled records and is evenly balanced between two…

The correct answer is C. Run a SageMaker warm start hyperparameter tuning job based on the current model's tuning job. You can't use Incremental training on Xgboost algorithm. https://docs.aws.amazon.com/sagemaker/latest/dg/incremental-training.html

Machine Learning Implementation and Operations

Question

A bank wants to use a machine learning (ML) model to predict if users will default on credit card payments. The training data consists of 30,000 labeled records and is evenly balanced between two categories. For the model, an ML specialist selects the Amazon SageMaker built-in XGBoost algorithm and configures a SageMaker automatic hyperparameter optimization job with the Bayesian method. The ML specialist uses the validation accuracy as the objective metric. When the bank implements the solution with this model, the prediction accuracy is 75%. The bank has given the ML specialist 1 day to improve the model in production. Which approach is the FASTEST way to improve the model's accuracy?

Options

  • ARun a SageMaker incremental training based on the best candidate from the current model's
  • BSet the Area Under the ROC Curve (AUC) as the objective metric for a new SageMaker
  • CRun a SageMaker warm start hyperparameter tuning job based on the current model's tuning job.
  • DSet the F1 score as the objective metric for a new SageMaker automatic hyperparameter tuning

How the community answered

(22 responses)
  • A
    5% (1)
  • B
    5% (1)
  • C
    82% (18)
  • D
    9% (2)

Explanation

You can't use Incremental training on Xgboost algorithm. https://docs.aws.amazon.com/sagemaker/latest/dg/incremental-training.html

Topics

#Hyperparameter Tuning#Amazon SageMaker#Model Optimization#MLOps

Community Discussion

No community discussion yet for this question.

Full MLS-C01 Practice