Hacker News new | ask | show | jobs
by arkades 3698 days ago
You confuse p-value with methodology. P-value is entirely a product of sample size and effect size. For a given effect size, the cheaper I want the study to be, the smaller I make the sample, and the less likely I am to reach a significant p-value.

The problem is when the methodology itself is broken. For instance, using case-control methodologies on things with small-to-moderate effect sizes. Past studies comparing such studies with eventual RCTs showed that the case control studies gave absolutely no indication of what the RCTs would show as a consensus: it was entirely random.

There is no amount of money, small or large, worth throwing at studies that shift our prior probability to posterior by 0 units.