|
|
|
|
|
by closed
3237 days ago
|
|
If one variant beats another, even with very few observations, the data DOES support that one is better. It's just that you might not be very confident that one is better. The key to understanding this situation statistically is by reframing the way you think about tests away from an all-or-nothing NHST, and toward either confidence intervals, or bayesian estimation. That is, some kind of measure of (loosely) uncertainty around a parameter (or entire model) of interest. |
|