[falcolas]

> But how many test suite have you seen which are less helpful?

I got ya. I have worked on software with a buggered mix of mocked and integration tests that fails about one time in four. But since the bug was in some asynchronous code and would appear in random tests, with random errors (even on thoroughly mocked tests), we can't easily smash it. It's one of those heisenbugs where enabling logging would cause all the tests to pass consistently.

And to put icing this cake, the software worked - this bug wouldn't appear in the production deploy.

So, yeah. The test suite was less than helpful. It certainly couldn't prove any qualities about the software we were writing.