|
|
|
|
|
|
by charleshmartin
1899 days ago
|
|
|
You can check for some signatures of over-fitting using the weightwatcher tool https://calculatedcontent.com/2021/04/04/are-your-models-ove... The tool identifies weight matrices that display atypical behavior, where the correlation is concentrated about unusually large matrix elements. The idea comes from statistical mechanics of generalization, where it is known that neural networks that are over-fit are atypical and are in the spin glass phase of the learning phase space. |
|
|