|
|
|
|
|
|
by diocles
3790 days ago
|
|
|
I've been thinking about the naming of this library, and I don't think "science" is a good metaphor for what it does. You can only test hypotheses of the form "A is exactly like B" - no bug fixes are allowed, because they will show up as differences. So a more accurate (but less cool) name might be "Refactoring" - you assert that all your tests still pass, where your tests are your production data. |
|
|
Of course they will. That's a feature. The system doesn't intrinsically know whether a change in behaviour is a bug added or removed, it can only report that there's a difference in behaviour, it's your job to investigate whether the control or the experiment is correct.