[mikeskim]

If people would just learn to resample (cross validate, use subsampling or the bootstrap), we wouldn't be having this pointless discussion at all.

[vasilipupkin]

In theory, you are correct, but some data sets are too small or make it too difficult to cross validate in a way, that is meaningful to the original problem