Hacker News new | ask | show | jobs
by db-news 938 days ago
Hi! Congratulations on GA! Been waiting for this.

I just heard about AWS CRT at the AWS ReInvent Innovation talk on Storage.

1. Does the Rust SDK use CRT under the hood? I use the Rust SDK to access S3 and wonder if there are any automatic performance gains?

2. I couldn't find good material on how AWS CRT works and how it is integrated with the Java or Python S3 connectors. I would appreciate a more technical explanation. Do you have any links that explains this in more depth?
1 comments
rusbus 938 days ago
The Rust SDK does not currently use the CRT under the hood. The CRT is a high performance C-Library for fast HTTP connections (and a lot more).

For S3, there is a meta-layer that interceps requests to S3 and converts them into ranged-gets and multipart uploads for parallelization.

It's quite complex and can also use significantly more memory, but it does allow for *much* faster uploads and downloads in some circumstances.

link