During batch training of a neural network, you notice that there is an oscillation in the loss. How should you adjust your model to ensure that it converges?

The correct answer is B. Decrease the learning rate hyperparameter. larger learning rates can reduce training time but may lead to model oscillation and may miss the optimal model parameter values.

Submitted by tunde_lagos· Apr 18, 2026ML model development

Question

During batch training of a neural network, you notice that there is an oscillation in the loss. How should you adjust your model to ensure that it converges?

Options

ADecrease the size of the training batch.
BDecrease the learning rate hyperparameter.
CIncrease the learning rate hyperparameter.
DIncrease the size of the training batch.

How the community answered

(34 responses)

A
3% (1)
B
79% (27)
C
6% (2)
D
12% (4)

Explanation

larger learning rates can reduce training time but may lead to model oscillation and may miss the optimal model parameter values.

Topics

#Learning Rate#Neural Networks#Model Training#Convergence

Community Discussion

No community discussion yet for this question.

Full PROFESSIONAL-MACHINE-LEARNING-ENGINEER Practice