Hacker News new | ask | show | jobs
by noloqy 4716 days ago
His choice of words is not very fortunate. If webpage A has an underlying conversion ratio of X, and webpage B has an underlying conversion ratio of Y, then if X is not equal to Y, in theory we could always find evidence that X is "significantly" different from Y.

If X is close to Y, we need a very large sample to achieve statistical significance on the hypothesis that they're not equal, whereas if X and Y are far apart, it is likely that a small sample will already indicate that fact.