[wink]

Let me give you the example of a test that hadn't ever failed on a dev machine or on staging or prod, just on the flaky CI infrastructure.

Yes, I'm mostly agreeing with you that the tests should be fixed, but I have seen ones that were perfectly fine (given the constraints) and what should have been fixed was the CI.

[codingdave]

Yes, but even in that scenario, it should be consistent, not flaky. If it always works in some environments and always fails in others, that is not ideal, but at least can be accepted. But if it sometimes works and sometimes fails, it should be investigated.