MLS-C01 · Question #345
An insurance company is creating an application to automate car insurance claims. A machine learning (ML) specialist used an Amazon SageMaker Object Detection - TensorFlow built-in algorithm to…
The correct answer is B. Reduce the value of the dropout_rate hyperparameter. When an object detection model overfits (performs better on training than testing data), adjusting regularization hyperparameters is key to improving generalization.
Question
An insurance company is creating an application to automate car insurance claims. A machine learning (ML) specialist used an Amazon SageMaker Object Detection - TensorFlow built-in algorithm to train a model to detect scratches and dents in images of cars. After the model was trained, the ML specialist noticed that the model performed better on the training dataset than on the testing dataset. Which approach should the ML specialist use to improve the performance of the model on the testing data?
Options
- AIncrease the value of the momentum hyperparameter.
- BReduce the value of the dropout_rate hyperparameter.
- CReduce the value of the learning_rate hyperparameter
- DIncrease the value of the L2 hyperparameter.
How the community answered
(31 responses)- A3% (1)
- B71% (22)
- C16% (5)
- D10% (3)
Why each option
When an object detection model overfits (performs better on training than testing data), adjusting regularization hyperparameters is key to improving generalization.
Increasing the value of the momentum hyperparameter primarily affects the optimization algorithm's convergence speed and stability, rather than directly addressing overfitting by controlling model complexity.
If a model is overfitting, it means it has learned the training data too specifically, including noise, and struggles to generalize. While typically increasing dropout helps, an excessively high `dropout_rate` can sometimes prevent the model from learning sufficiently robust and generalizable features from the training data, leading to a sub-optimal model on unseen data. In such a scenario, reducing the `dropout_rate` could allow the model to learn more meaningful patterns and improve its performance on the testing dataset by finding a better balance between bias and variance.
Reducing the value of the learning_rate hyperparameter primarily affects the step size during model weight updates; while it can sometimes help find a better minimum and indirectly improve generalization, it is not a direct regularization technique to combat overfitting like L2 or dropout.
Increasing the value of the L2 hyperparameter (weight decay) is a common and effective method to reduce overfitting by penalizing large weights and simplifying the model, but it is not the chosen correct answer in this context.
Concept tested: Machine Learning Overfitting Regularization
Source: https://docs.aws.amazon.com/sagemaker/latest/dg/tf-object-detection-hyperparameters.html
Topics
Community Discussion
No community discussion yet for this question.