Hacker News new | ask | show | jobs
by problems 3396 days ago
That's completely ridiculous, get some fucking RAID Amazon.

I order drives off newegg directly to my DC and I'm yet to lose data with the cheapest drives available in RAID10.

3 comments

Yes, solving problems at your scale and AWS' are quite comparable.
but I never lost data off an usb stick how hard could it be!
Really?!?! Several times USB sticks (and USB HDs) failed on me and other people I work with.
Not saying my scale is the the same at all - but the fact they can't do something so simple that I can do it as a single individual is embarrassing at best.

Simple solutions to this do scale - Linode and DigitalOcean don't have such issues for example - and while they're not Amazon scale, they are quite large and I'd say they prove the concept.

EBS data is backed up in multiple redundant ways (using erasure encoding I think).

Local storage is not intended for permanent storage, and is more use at your own risk. That's also why most of the new EC2 instances don't even support local storage.

Availability =/= durability of course

EBS is incredibly expensive and slow, not really a good solution. It'd be nice if they offered a better local storage option.
Incredibly expensive and slow compared to what? A 500 GB SSD (gp2) costs $50/m, and has 1500 - 3000 IOPS. It's okay for most loads.

For higher performance, you can use

1. EBS Provisioned IOPS (kind of expensive)

2. Aurora (for DB use)

3. The new I3 instances (super fast local storage at a reasonable price.)

That's the cost of a new 500GB SSD per month! For the cost of three months' EBS storage and a couple of hours you could setup your own RAID array with a spare for backups and possibly get better uptimes than Amazon :P
> 1500 - 3000 IOPS

So about as many as this SD card, and nothing compared to a real SSD.

I think most people rely on EBS and are happy with it. Sure it depends on the use case, but I think it works for most use cases.
It's not just a RAID that can fail. And everyone who uses AWS should expect failures. You should build your infrastructure to handle such failures well.
They offer no RAID on local storage and only the expensive, IO restricted EBS as an alternative.
Yes, the only way a server can die is from non-raided disks.
Otherwise they should at least be providing customers their data back.
I think you misunderstood the local storage. It is not intended to permanently store data. It's a volatile storage like RAM.