Hacker News new | ask | show | jobs
by iamacyborg 1038 days ago
Hate to say it but if your site was only getting a few thousand visitors a month your test was likely vastly underpowered and therefore irrelevant anyway
1 comments

Power is not just about sample size, but also (expected/previously informed by some other evidence) effect size. You can't make that conclusion without that.
For sure, but you’d need one hell of a good cta to be getting a sufficient effect size to warrant small samples.