Hacker News new | ask | show | jobs
by adpowers 5331 days ago
Sadly no mention of multipart upload. If you use S3's multipart upload feature you can get similar performance for one file by uploading multiple parts of the file at once. I saw a substantial throughput improvement when I implemented some multipart upload code, even when uploading from EC2.
1 comments

Totally true. However, I had to limit the scope of this post somewhere, and in this case, I focused on multithreaded upload of smaller objects, as mentioned in the first paragraph. We do have some larger object uploads, though they are a minority. I may do a separate followup post on high performance single file uploads through multipart uploading.