Hacker News new | ask | show | jobs
by nickm12 4027 days ago
> 95% statistical significance means, we got this number from a procedure that 95% of the time produces the right thing

The original post is incorrect about the probabilistic interpretation of the 95% confidence interface, but this interpretation is also wrong.

In classical statistics, p<0.05 means that, if there is no difference in our sample populations (i.e. the null hypothesis), then the probability of observing a difference at least this extreme is less than 0.05.