Hacker News new | ask | show | jobs
by yjftsjthsd-h 1540 days ago
Did you ever test doing nothing? I assume it's been studied, but I can imagine ways for 10% to actually be noise or seasonal/weekly/whatever variations.
3 comments

Yeah that’s called the control. We have very sophisticated automated systems for measuring all of this
This is called A/A testing and is used to vet the setup.
I thought A/B testing was the state of the art in that field, which would address your concern?