Hacker News new | ask | show | jobs
by bduerst 2374 days ago
That's a lot of data though, especially since it's usefulness goes down with time.
1 comments

It certainly is.

According to the NSA technical director at the time (2013) the Utah datacenter has a capacity around 5 Zettabytes.

Even 5EB would be a stretch for 2013. 5ZB is flat-out impossible. As another poster points out, that's years' worth of total worldwide drive shipments (most sources put it at less than 1ZB in 2013). Large buyers are further constrained by the fact that their demand can cause price spikes even at much lower percentages of the total. Not even No Such Agency has that kind of budget. The Utah facility also isn't physically big enough for that figure to hold. I work on large storage systems at one of those large buyers, and I've toured one of the several data centers where ours live. NSA's Utah data center looks to be on approximately the same scale, not orders of magnitude bigger. It's further plagued by power problems, which is another constraint on total size.

So I looked into that quote from the NSA director. What was actually said, apparently, was that the center was designed to hold up to 5ZB, not that it actually did. That seems to be a design based on some extremely optimistic assumptions about future drive density, power consumption, and cost. Needless to say, those assumptions were a bit silly at the time and have only seemed more so in retrospect.

P.S. It looks like TechCrunch came to almost exactly the same conclusions that I did, for very similar reasons. https://techcrunch.com/2013/07/24/the-nsas-massive-utah-data...

That seems hard to believe. That would be five billion 1TB hard drives.

Considering around 100 million hard drives are shipped per quarter, that would be over a decade of production.

For platter or SSD drives, sure. Some forms of magnetic tape storage can get up to 300 TB per cartridge though, which can scale up to petabytes in the right config.

Still ridiculous for information that is worth less and less over time.

300TB per cartridge in 2013? I think 10TB per cartridge was pretty high round then. That's still around half a billion tape cartridges, which are also very slow to read and write from.
There's rumours that the 2011 HDD shortage was actually due to the NSA buying it all.
Do you have a source for that 100 million figure? It strikes me as awfully low considering how many personal computers must surely exist in the world and how often they'd be replaced without reusing the drives, not even factoring in servers.
Sorry, that's per quarter. So it would be more like over a decade of all worldwide HDD production. Still crazy high IMO.