[hi-v-rocknroll]

Yup.

- They don't do enough or the right kind of smoke tests.

- They don't do exponential-canary deployments with an ability to rollback, and instead just YOLO it.

- They don't appear to have a customer-side security / client platform team update approval gating change control process for software updates or for definitions (or whatever they use).

This is fundamentally laziness and/or incompetency.

[tootie]

They say they run this process multiple times a day. Must be tens of thousands of deployments. I'd guess complacency set in at some point. Just completely inured to the risks they were taking.

[nine_zeros]

> This is fundamentally laziness and/or incompetency.

From management - that couldn't care less about low visibility, low impact projects

[mattmaroon]

I have been wondering why they didn’t do canary deployments. Seems like quite an obvious thing to do.