Hacker News new | ask | show | jobs
by imh 3440 days ago
If you decide to stop when a test says the error rate (FPR) is 5%, your error rate will be higher than 5%. If you don't want to call that a failure mode, it's at least a misuse of the metric.