Hacker News new | ask | show | jobs
by andrewprock 1923 days ago
This feels off by a couple of orders of magnitude, unless a significant number of the parameters are not independent.
2 comments

Well, that's the "magic" of modern deep learning. You can fit models with p > n somehow without overfitting. In some areas you might find this called "the strong inductive bias of neural networks" or "double descent" but no one has found a convincing explanation (to me).
It's quite amusing. The standard statistical theory does not work at all in estimating data vs model size, and the bounds are all vacuously large. It's a very active area of research, understanding why models act so simple when overparameterized and coming up with real measures of model complexity. Lots to read there if you are interested in such things.
That just means that the parameters are not independent.
But you can fit randomly-generated labels!
That's not in any way surprising. When you have more parameters than data, this is trivial.