[plopz]

You also need a large enough user base/level of traffic where releasing to a small percentage of your users would even uncover a problem.

I've had similar problems with A/B testing where a low amount of traffic means I would have to wait a long time to get meaningful data during which confounding variables naturally get introduced.