Hacker News new | ask | show | jobs
by Symmetry 5171 days ago
Those tests for statistical significance aren't very strong in this case. It might be that the study in question only had a 5% chance of giving this result by chance, but given that this particular study was selected to our attention for news-worthiness the actual chance of it being a valid result are far less than 95%[1]. Also, a sizeable minority of published papers have statistical errors, even in good journals[2].

[1]http://xkcd.com/882/ [2]http://www.economist.com/node/2724226

1 comments

You are right in general, but the study in question actually claims 99.9% significance, not 95%. That's pretty strong.
Ah, thank you for pointing that out. It changes things quite a bit.