Hacker News new | ask | show | jobs
by lmartel 3808 days ago
I agree with the unrepresentative part, but absolute sample size numbers don't tell you anything. For some experiments, N=100 is more than enough, and for others N=10000 isn't even close. Did you look at the p-values or any other confidence measurements?
1 comments

Statistically, doesn't a sample size of 2000 get you pretty close to +/- a 5% margin of error?
I'm not sure what you mean by 'statistically' above.

In general you can't say whether a sample size of 2000 will get you within a specific margin of error without additional information. It very much depends e.g. on what the hypothesis you're testing is or what you're trying to estimate.