[theptip]

One interesting thing about going to continuous (or near-continuous) testing is you can get much narrower error bars on your baseline.

If you test once a month, how do you know if you accidentally tested during a transient spike?

If you test continuously, you can roll up those measurements to get things like p95, stddev, whatever.

So it’s useful even if you don’t want to respond in minutes to a spike. (You probably don’t need per-second readings for this, hourly would be enough.)

I don’t know if transient spikes are considered a risk factor, but you also get more chance to resolve those too.