|
|
|
|
|
by yummyfajitas
3839 days ago
|
|
I didn't claim it did - all I said is that this gives Occams Razor as an asymptotic law. Intuitively, I'm claiming: Lim_{complexity -> infinity} P(theory having fixed complexity) = 0 Stated more precisely, fix a prior distribution, then for any epsilon > 0, I can find a complexity cutoff C (which depends on the prior) so that P(any theory with complexity > C being true) < epsilon. This doesn't mean that P(theory|complexity) is monotonically decreasing, that would be a much stronger claim. I don't know how this isn't a compelling argument, it's a provable mathematical statement. |
|
jwmerrill's razor: points in the plane should be considered to be close to the origin unless there is evidence otherwise.
Is this a reasonable law? As reasonable as Occam's razor? I think probably not, but I don't have a strong opinion. One interesting thing to note is that the law doesn't say where the origin is (similarly, Occam's razor is vague about what exactly is meant by "simple" and "complex").
Finite asymptotic form: for any finite point set, there is a distance D such that no point in the set is further from the origin than D.
Continuous asymptotic form: given any function from points in the plane to non-negative numbers which has a finite integral, there is a distance D such that the integral of the function over the region that is further from the origin than D is less than any epsilon_1, and such that the function is everywhere less than any epsilon_2 on this region except perhaps on a set of measure 0.
The asymptotic forms are provable mathematical statements, but I think it would be a mistake to say that either of them is a very compelling argument for the original statement of "jwmerrill's razor."
Without intending to call you out in particular (I don't know what opinions you hold), I think people sometimes accept some odd logic in probability theory that they would be less likely to accept in other contexts. Bayesian probability theory provides practical solutions to a lot of interesting problems, and I personally wish people would emphasize those cases more, and make fewer sweeping statements about it being a consistent theory of all of the scientific method.