[crazyjncsu]

We had a bunch of servers get taken out by this. We were able to failover with backups from the last 12 hours.

The incident sounded suspicious from the start, but the wording “could not control the fire in SBG2” sounds very ominous ... Chernobyl-y even.

And seeing the compactness of the entire facility (https://baxtel.com/data-center/ovh-strasbourg-campus/photos), it seems an uncontrolled fire could take out all three buildings in short order. I’m very interested in seeing the damage and postmortem from this one.

Also interesting they tout all sorts of sophistication (https://www.ovh.com/world/us/about-us/datacenters.xml), but no mention of fire suppression

[cpncrunch]

Fire extinction is mentioned here:

https://us.ovhcloud.com/about/company/security

Out of curiosity, which backups are these? Are they OVH backups? I just noticed that our OVH backup server is in the same region as our server (BHS).

[crazyjncsu]

S3 backups. It’s part of this pseudo-cloud orchestrator we wrote for moving around instances of our single-tenant app.

[cpncrunch]

Thx. S3 seems to be the best way to go.