Hacker News new | ask | show | jobs
by smallnamespace 2033 days ago
> the amount of error a perfect Bayesian makes as they observe event and bet on the next one, ad infinitum, is finite.

There's a little assumption that you're leaving out, namely that the Kolmogorov complexity of the data generating process is finite. From Wikipedia:

> expected cumulative errors made by the predictions based on Solomonoff's induction are upper-bounded by the Kolmogorov complexity of the (stochastic) data generating process

Whether the universe (or our observations of the universe) have finite complexity is very much an unresolved philosophical question.

2 comments

> Whether the universe (or our observations of the universe) have finite complexity is very much an unresolved philosophical question.

Every time there was a significant advance in physics, it tended to go towards simplification and unification. Geocentrism required epicycles. Then Keppler came up with his ellipses. Then Newton unified celestial and terrestrial laws. Maxwell & Einstein allowed us to view time as less special dimension than we thought it was…

I won't presume about the initial state of the universe, to the extent such a notion is even meaningful. But the fact that it is governed by mathematics, and relatively simple maths at that, sounds likelier and likelier every quarter-century.

And I'm not even talking about everyday life, where we can observe in practice that the simplest theories about who ate the last cookie (little Mike, who lives in the house) are more often true than the more outlandish ones (magical imps, which we never witnessed).

> Every time there was a significant advance in physics, it tended to go towards simplification and unification. Geocentrism required epicycles. Then Keppler came up with his ellipses. Then Newton unified celestial and terrestrial laws. Maxwell & Einstein allowed us to view time as less special dimension than we thought it was…

Unification, maybe. Simplification, no. That's evident if you just scroll down the list of Nobels in physics. You even mentioned Einstein, but I don't know how you could claim general or special relativity are simpler than Newtonian physics.

> I don't know how you could claim general or special relativity are simpler than Newtonian physics

Careful there! You cannot compare both theories in isolation from observation. Newtonian theory fails to match observation if high velocities or big masses are involved.

In order to "fix" that using just Newtonian physics, we're back to figurative epicycles.

Taking observations into account, SR is simpler than Newtonian physics in that it has a greater predictive power.

Remember that if you come up with something simpler than SR it also has to match observation at least as well as SR.

If quantum is really random, then our universe has infinite Kolmogorov complexity.
Not quite.

Under the many-world interpretation, when you send a photon through a half sieved mirror, the universe splits in one version where the photon goes through, and one universe where the photon doesn't. This is all very deterministic.

What the researcher subjectively observe however is another matter. If the universe splits, so does the researcher. The problem of observing outcomes turns into an anthropy problem: if I split myself in two copies, in which copy am I likeliest to find myself into? I'm not sure making bets about that even makes sense: which copy I find myself into has no bearing in the final state of the universe.

Most observers will find themselves in universes with infinite kolmogorov complexity.
Care to explain why?
Most bitstrings are not compressible, so if we look at all the observers across the splitting universes watching a continuous quantum coin flip, most will observe a coin flip sequence that is not compressible, so will observe a constant increase in Kolmogorov complexity.
Is Newtonian mechanics real? Well, its not strictly real, but it's apparently real enough for engineering cars, planes, and rockets.

So even if quantum is really random, I'd bet an unbiased coin will still land on heads with 50% probability every time.

No, just because a process is probabilistic, in does not immediately follow that it has infinite Kolmogorov complexity. For example the probabilistic effects could cancel out.
quantum is not the same as random, this analogy breaks down quickly as you try to explain the experimental results