|
|
|
|
|
by minimaxir
3330 days ago
|
|
> Also, what does "fully converged" signify? In machine learning/deep learning, the decrease in training loss has major diminishing returns as training continues. Eventually, training the model hits a point where the loss barely improves each epoch/iteration. (fun visualization from one of my projects: http://minimaxir.com/img/char-embeddings/epoch-losses.png) In some cases, the loss can stop improving entirely, or increase. |
|