Hacker News new | ask | show | jobs
by gervu 2519 days ago
Automation of any sort will sometimes accidentally your data, whether due to periodic hiccups, system instabilities and bugs, operator misunderstandings or errors, or random cosmic ray strikes.

The exact reason it blows up isn't even necessarily all that important, other than in its effect on what you should be doing to reduce the probability of downtime. Well-engineered systems are routinely developed from less than completely reliable parts. Stuff fails, we design for it.

It's certainly not reason not to use it, if it's resulting in a net positive gain in your ability to get things done and maintain control and transparency over your deployed systems.

But it's certainly a good reason (among a long list of good reasons) to make sure you have a good backup routine in place, including regular testing of both their integrity and your ability to restore a working prod system from them quickly.

2 comments

>Automation of any sort will sometimes accidentally your data,

Distributed scalable automation will accidentally your data slightly more often. The more stuff you have the more edge cases and bugs you have.

Scale big fail big as I like to say.

Accidentally what? =)
Delete, but the word delete is deleted. Yo dawg.
accidentally the whole thing
You weren’t around in the slashdot days were you?
your data.