Hacker News new | ask | show | jobs
by nonbel 2352 days ago
If you can come up with 300 different explanations for a random blip, your theory is obviously very flexible. You are probably overfitting.

If your solution to the problem of not being able to generalize your model to new/other data is to add more parameters. You are probably overfitting.

These are the hallmarks of overfitting.

Sorry that you cannot learn from others and only expect them to learn from you.

1 comments

Look at this: theorists come up with something like 300 different models, and you declare they all used the same theory to do it? Of course they didn't! Why would you assume they all did the same thing?!

Further, of the various frameworks used, many will have been created by imposing some further symmetry on the standard theory, in effect decreasing the number of free parameters!

Can you point out one that was inconsistent with the foundations of physics? I suppose it is possible some were that radical.
So now you demand that a new theory shouldn't describe what the old theory describes? Just what do you put into the concept of "overfitting"?!