Hacker News new | ask | show | jobs
by st1x7 2029 days ago
> the probability of that coin toss being 50% does not talk about the coin; it talks about you, and about your partial knowledge of the universe.

But it does talk about the coin - a weighted coin would have a different probability. Same in the example with the white/black balls - if they weren't 5 white and 5 black but 6 white and 4 black, the probability you would assign to the top one would be different. Again, the probability is a way to describe the balls themselves, not just our knowledge.

I get the general idea of representing probability as uncertainty and partial knowledge but your statements strike me as just straight up incorrect.

6 comments

Thought experiment: you're presented a jar, and offered the chance to bet ten bucks on drawing a white ball. You know nothing about the content of the jar. What odds would you take?

Now, you see ten white balls get added, then are blinded while other balls are added (maybe). You estimate the jar can't hold more than about a hundred balls. What odds would you take?

Now, you see ten white and ten black get put in, and saw it was empty before. What odds?

Now, you see ten white and fifty black, but the whites are larger, and you get to draw a ball. What odds?

The difference between the second-to-last and the last is the missing information we usually think of when we talk about randomness being missing information.

And you'll see that the previous scenarios don't change anything about that.

This is still a partial knowledge situation - you have the information that there are a certain proportion of colored balls in the chamber, but not the information about their order. The probability includes the information we do know and allows inferences about information we don’t know.
Sure, I just can't agree with the parent statement that probability has nothing to do with the object it describes, which is demonstrably false.
It has to do with your knowledge of the object. To that extent, it has something to do with the object it describes.
They didn't say that it has "nothing to do with the object it describes" though. It has to do with your knowledge, which itself has to do with the object your knowledge describes
"The probability of that coin toss being 50% does not talk about the coin." I think there is a subtle equivocation going on here.
Well, it's getting philosophical now. We do not have a way to experience the true nature of the coin. We can only experience an "image" [0] of the coin and we summarize all "images" of that object into knowledge.

[0] by image I do include your vision, but also hearing, feeling and other methods of perception.

I do not think there is anything very philosophical here, just the point that the claim in the post I was replying to was demonstrably false.

I am intrigued by the idea of the coin having a "true nature" that we have no way to experience; I would like to know what this elusive "true nature" is, but if we cannot experience it, I don't suppose you can tell me. Instead, I will settle for an explanation of how you know it has such a true nature.

I don't think it's demonstrably false: If you don't know that the coin is weighted, the probability is 50%. Probabilities are predictions and estimates, not fundamentally about the thing itself, but about what we know about the thing.
The principle of indifference? I know that it is a commonplace assumption, but feels to me as though one is assuming one has more information than is justified. Coming back to the article's "economist's wager", is it rational to bet with even odds on something you know nothing about? If the assumption is interpreted as a testable hypothesis about outcomes, why would complete ignorance imply any particular result? On the other hand, if it is interpreted strictly as a statement about one's knowledge, why present it exactly as if one had sufficient knowledge of the situation to know that the probability is 0.5? Maybe the author will have an answer in part 2.
> If you don't know that the coin is weighted, the probability is 50%.

No, if it's weighted it's not 50%. Your prior probability is 50%, but neither a Bayesian nor a frequentist would claim the true probability is known before testing.

There is no such thing as "true probability" in Bayesian interpretation, it only exists in frequentist world.

Notice that it is possible to build a robot which flips a coin in such a way that it's always heads - sure you might need to build a different robot if the coin is "biased"(you probably mean its weight distribution is uneven) but it's still possible.

But that’s the thing: the “true“ probability is unknowable, and may even be an ill-defined concept. It is a deterministic process, so “probability“ is just a simplifying concept to describe our best guess belief about how the coin behaves in the aggregate.
The true probability requires an infinite sequence of tests, so it's by definition unknowable. But it's what any sort of statistics attempts to approximate.
> the true probability

Interesting expression.

After testing, it turned out that you flipped it and it landed on heads.

Does that mean that you've discovered that the "true probability" for that flip should have been 100% heads?

Of course not. If you're a frequentist you can say your best estimate is 100% heads with an unknown variance, and if you're a Bayesian you work out p(a|b) = p(b)p(b|a)/p(a) and update your priors (which will not give 100% heads). The more coins you flip, the better you can estimate the true probability
IMO (I should have defined this) the true probability would require an infinite sequence of tests to determine.
I like the balls in container better - the mechanics of determinism is more obvious - and the contrast between perfect and partial knowledge.

And there's another interesting point - you could view "there's five white and five black balls" as your model. If in reality, there's one white ball and nine black - then your math is still right, but your model is wrong.

If you do experiments with the wrong model (assuming 50/50, getting samples from 1/10) - your best conclusion would be the model is wrong.

But for many settings, you'd end up declaring your container or the hand used to pull out balls has magical powers. (and to borrow from Douglas Adams go on to prove that black is white, and get killed in the next zebra crossing).

> But it does talk about the coin - a weighted coin would have a different probability.

Nobody would a priori assume it is a weighted coin, in this example. A coin is chosen because it's been a standard weight and measure-backed object for centuries. It is about the observer's knowledge, which includes assumptions from every day experience.

You have to base a prior on assumptions. If you assume nothing and flip it 1000x, and calculate the probability, than you base that on assumptions of your own flipping ability, and hand wave it away with count divided by trials.

>Again, the probability is a way to describe the balls themselves, not just our knowledge.

Probability is about the fact that you don't know everything about the balls themselves. If you could make 100% predictions then your knowledge of the balls would be equivalent to the balls' description.

Why do you even use "describe the balls themselves" to describe this situation? From the perspective of probability you just set an upper bound to how much knowledge you could possibly have about an object, it's still knowledge.

I think this is just semantics; whether you read the parent comment as describing a hypothetical and fair coin with 50% chance for each state, versus saying that a god-like entity could reduce this to a deterministic computation via replaying the coin flip exactly (eg. same ambient air conditions, position of coin on finger, exact sequence of muscle nerve activations..) and that because that's impossible for you to do you just assign the minimum-information-content-probability to the coin flip (50%)