|
|
|
|
|
|
by pheug
2174 days ago
|
|
|
Very useful for storing medium/large-scale crawls. Common Crawl is 200TB+ per month (http://commoncrawl.org/connect/blog/). Uncompressed, if compressed it'd probably go through one such disk every 1-2 months. My own crawling operations consume about half a TB each month. Storing high resolution (1080p/4K) videos is another big spacehog |
|
|