|
|
|
|
|
|
by noloqy
4716 days ago
|
|
|
In statistics there is a "golden rule", that when np > 5 and n(1-p) > 5, then the normal distribution is a good approximation for the binomial distribution. Here n is the number of experiments and p is the conversion rate. Our A/B testing data results from a Bernoulli experiment, and thus is binomially distributed. So indeed, if we use tests that assume a normal distribution, if we want to approximate the binomial distribution when p is 0.0001, n needs to be roughly 50k. |
|
|