[leephillips]

Nice article, on the whole, and usefully provocative.

But I have misgivings about making these close connections between information theory and scientific theory-making. As everyone knows, information theory leaves out any notion of semantics, as it should. But the important thing about our theories of the world is that they have meaning to us. The scientist searches for something that makes sense of the world, not an algorithm for computing a series of numbers. The theories that we search for may not have the smallest Kolmogorov complexity; the criteria that they satisfy go a lot deeper.

[texasbigdata]

That’s such a great phrase: usefully provocative. Thanks for that.