Hacker News new | ask | show | jobs
by edvinasbartkus 4922 days ago
That's why AWS Data Pipeline came along. http://aws.amazon.com/datapipeline/
1 comments

Data Pipeline looks like a fine orchestration service, but it's not going to ingest 48 TB of data any faster than you can do it yourself. Which is probably not that fast.