Hacker News new | ask | show | jobs
by alextgordon 3994 days ago
> Another interpretation is that since variability difference is not universal (in 5 countries it is not statistically significant), variability difference is cultural. The later interpretation is argued in PNAS paper cited below.

How do they reach this conclusion? 36 for, 5 against at 95% significance level would expected given random variation, no?

1 comments

A significance level says very little, if anything, about the probability of getting an "insignificant" result given that the null hypothesis is false. That's all about statistical power. It's entirely possible that those "5 against" were just underpowered (sample size too small). Or that the sample sizes were systematically too small, and those 5 just happened to be the ones that failed to reach statistical significance. Or that the study was actually well-powered and the difference really is localized geographically.

Either way, a 95% significance level by itself tells us little about how we should interpret those 5 against.