DP-100 · Question #92
You are a data scientist building a deep convolutional neural network (CNN) for image classification. The CNN model you built shows signs of overfitting. You need to reduce overfitting and converge…
The correct answer is A. Reduce the amount of training data. C. Add L1/L2 regularization. C: Weight regularization provides an approach to reduce the overfitting of a deep learning neural network model on the training data and improve the performance of the model on new data, such as the holdout test set. Keras provides a weight regularization API that allows you to…
Question
Options
- AReduce the amount of training data.
- BAdd an additional dense layer with 64 input units
- CAdd L1/L2 regularization.
- DUse training data augmentation
- EAdd an additional dense layer with 512 input units.
How the community answered
(39 responses)- A69% (27)
- B18% (7)
- D3% (1)
- E10% (4)
Explanation
C: Weight regularization provides an approach to reduce the overfitting of a deep learning neural network model on the training data and improve the performance of the model on new data, such as the holdout test set. Keras provides a weight regularization API that allows you to add a penalty for weight size to the Three different regularizer instances are provided; they are: L1: Sum of the absolute weights. L2: Sum of the squared weights. L1L2: Sum of the absolute and the squared weights. A: Because a fully connected layer occupies most of the parameters, it is prone to overfitting. One method to reduce overfitting is dropout. At each training stage, individual nodes are either "dropped out" of the net with probability 1-p or kept with probability p, so that a reduced network is left; incoming and outgoing edges to a dropped-out node are also removed. By avoiding training all nodes on all training data, dropout decreases overfitting. https://machinelearningmastery.com/how-to-reduce-overfitting-in-deep-learning-with-weight- https://en.wikipedia.org/wiki/Convolutional_neural_network
Topics
Community Discussion
No community discussion yet for this question.