Hacker News new | ask | show | jobs
by nialo 5171 days ago
You just run more tests, such that 25% of tests run still turns out to make $$$$ at least.
1 comments

Well, keep in mind that, with a significance threshold of 5%, one in twenty null-result tests will appear to have significance.

So just continuing to test until you get a result is not necessarily going to net you anything.