Hacker News new | ask | show | jobs
by enriquto 2024 days ago
A simple sentence that I've found useful for pedagogy: "the probability of that coin toss being 50% does not talk about the coin; it talks about you, and about your partial knowledge of the universe."

You can add: "The coin toss itself is deterministic and the result can be computed if you know the initial position and speed." They will inevitably bother you about the physical impossibility to measure the starting position and speed exactly, and then you say "ok, forget about the coin. You have 5 white and 5 black balls inside this opaque cylinder. What's the probability that the top ball is white? This does not talk about the balls (the color of the top one is already determined) but about your partial knowledge of them".

(EDIT: formatting)

8 comments

> the probability of that coin toss being 50% does not talk about the coin; it talks about you, and about your partial knowledge of the universe.

But it does talk about the coin - a weighted coin would have a different probability. Same in the example with the white/black balls - if they weren't 5 white and 5 black but 6 white and 4 black, the probability you would assign to the top one would be different. Again, the probability is a way to describe the balls themselves, not just our knowledge.

I get the general idea of representing probability as uncertainty and partial knowledge but your statements strike me as just straight up incorrect.

Thought experiment: you're presented a jar, and offered the chance to bet ten bucks on drawing a white ball. You know nothing about the content of the jar. What odds would you take?

Now, you see ten white balls get added, then are blinded while other balls are added (maybe). You estimate the jar can't hold more than about a hundred balls. What odds would you take?

Now, you see ten white and ten black get put in, and saw it was empty before. What odds?

Now, you see ten white and fifty black, but the whites are larger, and you get to draw a ball. What odds?

The difference between the second-to-last and the last is the missing information we usually think of when we talk about randomness being missing information.

And you'll see that the previous scenarios don't change anything about that.

This is still a partial knowledge situation - you have the information that there are a certain proportion of colored balls in the chamber, but not the information about their order. The probability includes the information we do know and allows inferences about information we don’t know.
Sure, I just can't agree with the parent statement that probability has nothing to do with the object it describes, which is demonstrably false.
It has to do with your knowledge of the object. To that extent, it has something to do with the object it describes.
They didn't say that it has "nothing to do with the object it describes" though. It has to do with your knowledge, which itself has to do with the object your knowledge describes
"The probability of that coin toss being 50% does not talk about the coin." I think there is a subtle equivocation going on here.
Well, it's getting philosophical now. We do not have a way to experience the true nature of the coin. We can only experience an "image" [0] of the coin and we summarize all "images" of that object into knowledge.

[0] by image I do include your vision, but also hearing, feeling and other methods of perception.

I don't think it's demonstrably false: If you don't know that the coin is weighted, the probability is 50%. Probabilities are predictions and estimates, not fundamentally about the thing itself, but about what we know about the thing.
The principle of indifference? I know that it is a commonplace assumption, but feels to me as though one is assuming one has more information than is justified. Coming back to the article's "economist's wager", is it rational to bet with even odds on something you know nothing about? If the assumption is interpreted as a testable hypothesis about outcomes, why would complete ignorance imply any particular result? On the other hand, if it is interpreted strictly as a statement about one's knowledge, why present it exactly as if one had sufficient knowledge of the situation to know that the probability is 0.5? Maybe the author will have an answer in part 2.
> If you don't know that the coin is weighted, the probability is 50%.

No, if it's weighted it's not 50%. Your prior probability is 50%, but neither a Bayesian nor a frequentist would claim the true probability is known before testing.

There is no such thing as "true probability" in Bayesian interpretation, it only exists in frequentist world.

Notice that it is possible to build a robot which flips a coin in such a way that it's always heads - sure you might need to build a different robot if the coin is "biased"(you probably mean its weight distribution is uneven) but it's still possible.

But that’s the thing: the “true“ probability is unknowable, and may even be an ill-defined concept. It is a deterministic process, so “probability“ is just a simplifying concept to describe our best guess belief about how the coin behaves in the aggregate.
> the true probability

Interesting expression.

After testing, it turned out that you flipped it and it landed on heads.

Does that mean that you've discovered that the "true probability" for that flip should have been 100% heads?

I like the balls in container better - the mechanics of determinism is more obvious - and the contrast between perfect and partial knowledge.

And there's another interesting point - you could view "there's five white and five black balls" as your model. If in reality, there's one white ball and nine black - then your math is still right, but your model is wrong.

If you do experiments with the wrong model (assuming 50/50, getting samples from 1/10) - your best conclusion would be the model is wrong.

But for many settings, you'd end up declaring your container or the hand used to pull out balls has magical powers. (and to borrow from Douglas Adams go on to prove that black is white, and get killed in the next zebra crossing).

> But it does talk about the coin - a weighted coin would have a different probability.

Nobody would a priori assume it is a weighted coin, in this example. A coin is chosen because it's been a standard weight and measure-backed object for centuries. It is about the observer's knowledge, which includes assumptions from every day experience.

You have to base a prior on assumptions. If you assume nothing and flip it 1000x, and calculate the probability, than you base that on assumptions of your own flipping ability, and hand wave it away with count divided by trials.

>Again, the probability is a way to describe the balls themselves, not just our knowledge.

Probability is about the fact that you don't know everything about the balls themselves. If you could make 100% predictions then your knowledge of the balls would be equivalent to the balls' description.

Why do you even use "describe the balls themselves" to describe this situation? From the perspective of probability you just set an upper bound to how much knowledge you could possibly have about an object, it's still knowledge.

I think this is just semantics; whether you read the parent comment as describing a hypothetical and fair coin with 50% chance for each state, versus saying that a god-like entity could reduce this to a deterministic computation via replaying the coin flip exactly (eg. same ambient air conditions, position of coin on finger, exact sequence of muscle nerve activations..) and that because that's impossible for you to do you just assign the minimum-information-content-probability to the coin flip (50%)
Forget the coin and the balls — does the nucleus decay? You're not missing any knowledge; there isn't any.
This is definitely the most interesting example, but it's not obvious that a situation where the relevant information is fundamentally inaccessible is a situation where you aren't missing any information.

It's your best bet for a scenario where you can be sure that nobody else has more information than you do, though.

It may be deterministic, but are you sure it would be computable? One does not necessarily imply the other.
As a caveat, while this intuition works for classical mechanics, it does not work for quantum mechanics. All observations are consistent with wave function collapse being fundamentally random. Any hidden variables would need to be transmitted many times faster than the speed of light (~10000x, last time I checked the experiments), and are therefore inconsistent with our understanding of special relativity.
Note that pilot wave theory, an (out of vogue) interpretation of quantum mechanics, also recasts the apparent randomness in quantum mechanics as due to our ignorance of the exact state of the pilot wave.

Even Einstein struggled with quantum mechanics, famously saying "[God] does not play dice with the universe".

Wigner's friend might have something to say about this...

I don't have a specific argument to make here, only the feeling that if it were all just a matter of what a given observer knows, no-one would be talking about there being a QM measurement problem.

This is a very good point!

In fact, some people do argue that there is no measurement problem in the Copenhagen formulation of quantum mechanics to begin with – at least if you take it seriously and strictly go by the rule that the laws laid down by Bohr et al. only concern you as the observer and your knowledge about the system, and not the system itself. Following this train of thought, there is nothing "real" about the wavefunction and it is just a tool to come up with predictions. The same goes for the collapse of the wave function (which just describes a change in your ability to predict future measurements, and not a change of the object) and the term "measurement" (which we might as well replace with "enlightenment", i.e. the moment in which we obtain knowledge about the system).

In that sense, the only difference between classical and quantum mechanics is that our knowledge (viewed as a mathematical quantity) behaves differently in both theories: In classical physics, when we conduct multiple measurements of a given system in a row, our knowledge about that system will increase – to the point that, once we have measured all system properties to sufficient accuracy, we'll able to predict what any future measurement of any of those properties will yield (again, with some predictable uncertainty). So the knowledge of all our measurements has added up, it is an additive quantity.

In QM, this is fundamentally different: We can only know anything about the object the very moment we look at it. The rules of quantum mechanics (again, in the very strict interpretation laid out above) dictate that the second we conduct a measurement, we can forget about any knowledge obtained through previous measurements of other (conjugate) observables: Future measurements of those observables are inherently unpredictable. In that sense, our knowledge about quantum-mechanical objects never "adds up" to anything. (To see that this is really the the distinguishing feature between classical and quantum mechanics, recall that the existence of conjugate observables really is the only thing setting apart the quantum from the classical world: Without conjugate observables it would be impossible to distinguish, say, 100 electrons in a superposition of spin up and down from an ensemble of 100 electrons of which 50 are in a spin up state and the other 50 are in a spin down state.)

Of course, this whole interpretation is very unsatisfactory to lots of people (myself included) for a whole bunch of reasons. I assume that, to a large degree, this is due to the fact that laws of nature that put human observers in their very center seem rather undesirable. (At least since the time we switched from a geocentric to a heliocentric view of the world.)

But my impression is that there's another reason: Our intuition from classical mechanics & statistics has taught us that objects exist independently of us as observers and behave in a deterministic fashion, at least provided we as observers know enough about them. (Meaning that the more we know about the coin's initial position and velocity, the more likely we are to predict the outcome of the coin toss. If we don't know anything about the coin, though, the outcome is as unpredictable as measuring spin up/down in quantum mechanics.) Unfortunately, this whole line of argument is circular: The reason we believe that the existence of physical objects is independent of us, is precisely because knowledge in classical mechanics is an additive quantity and we can get to the point where we know "enough" to come up with deterministic predictions. That is, we never have to discard knowledge when running new measurements and so our knowledge takes on a independent "role" – which we call reality.

This is basically the Bayesian interpretation of probability.
Saying that "the probability of a coin toss of 50% talks about you" is not an interpretation of probability. Saying that we are "50% sure" is also not an interpretation of probability. It's a nonsensical statement. It's like saying we are "50% angry". It doesn't really mean anything.
I don't understand your claims that these statements are are meaningless. They are commonly uttered and understood.
I can understand expressions such as "pretty sure" or "completely sure". I do not understand the expression "to be X% sure". If someone says they're "37% sure" tomorrow will rain, what does that mean exactly?
Can you understand expressions like "more sure of A than B" or "as sure of A as of B"? Then, they are as sure that tomorrow will rain as they are sure that throwing three dice the sum will be 9 or less (37.5%).
It's clear that 37.5% sure is 0.5% more sure than 37% sure. The problem remains how to interpret these numbers.
37% of the time that someone says they are 37% sure of a statement X the statement X is true (assuming they're calibrated correctly/etc).
Of course. But if you pronounce a fancy word like "bayesian" there's a large amount of minds that shut irremediably.
That's also why we call it QBism [1] instead of quantum bayesianism

[1] https://en.wikipedia.org/wiki/Quantum_Bayesianism

There seems to be a lot of quibbling about the simple sentence here but I find it clarifying. Discussing coin tosses is a thought experiment with a very practical physical analog so spelling out clearly what the thought experiment's actual subject is has valuable properties so you don't get lost in the weeds of the physical execution of flipping coins.
How does the ball situation help? It has the same problems of physical impossibility of measuring however the balls were ordered. (Modelling someone's brain?) I guess the argument works on someone with an unscientific model of the human brain, but that's one step forward and two steps back.
Somebody just put the balls there carefully, and did not tell you in what order, just how many of each color.
That still boils down to a lack of prior information which I don't think removes the argument for "I don't have enough information."

Probably have to use actual quantum phenomena that behave probabilistically by definition if you want a currently irrefutable physical example.

I'm personally not convinced even this is fundamentally probabilistic and we currently have to rely on probability theory as a crutch for complex behaviors we just quite don't understand yet or don't have the time and resources to compute.

> "I don't have enough information."

My point exactly. Probability theory is a precise mathematical formalization of the concept of "not enough information".

You don't need quantum physics to formulate a philosophical standpoint that happens to agree with the Kopenhagen Interpretation.

I'm not sure if it helps, but I suppose a compromise here would be the assumption that you don't really know the starting configuration of yourself, why you draw probabilistic inferences naturally, that the sun will go up tomorrow like every day.

If that has a biologic explanation, then the top comment was not just to the illusive argument of platonic ideals.