Hacker News new | ask | show | jobs
by Veratyr 3830 days ago
Many home users have managed to saturate their (unusually fast) connections sending/receiving to Amazon Cloud Drive: https://www.reddit.com/r/DataHoarder/comments/32oniv/so_how_...

And it doesn't have Glacier-like restrictions, at least in terms of retrieval delay. Nor does Backblaze. The difference with Backblaze is that it's only replicated within a single datacenter. If anything happens to that DC you're out of luck.
1 comments
mahyarm 3830 days ago
The typical pattern for photo users will be a large amount of upload at the start as they upload their collection, then occasional browsing of photos on the amazon website, which will be mostly smaller thumbnails. Rarely once in awhile users will request large originals. You will have an even smaller amount of people download their entire collection of originals.

With these patterns, you can make a system that puts everything on S3 at first, makes thumbnails and starts moving most things to glacier based on access patterns.

link
Veratyr 3830 days ago
Such a system would be wonderful, particularly if it used Backblaze B2 or Google Nearline instead of Glacier (to get around the hours of delay).

Unfortunately, no such system yet exists and the complexities of dealing with many people's libraries (particularly regarding RAW files) make it more difficult than it seems (I've looked at doing this myself in the past).

link