[etaioinshrdlu]

See also: https://github.com/archiecobbs/s3backer

Run a normal filesystem on top of S3! (Non-shared.)

In theory it might have really good performance due to your kernel caching blocks and files, and 25Gbit throughput to S3. Dependent of course on your instance being in EC2 and in the right region and having a big enough instance to get 25Gbit network.

I tried AWS EFS and found the performance very sad. Like 100Mbit even with a 25Gbit instance and the highest-specced EFS filesystem.

[kondro]

EFS performance was tied to how much storage you were using (at the rate of 50KiB/s per GB stored… with the ability to burst to 100MiB/s based on a credit system. A file system storing 256GiB can sustain 12.5MiB/s and burst to 100MiB/s for up to 180 minutes per day.

If you like, you can now specifically provision throughput for EFS at the rate of about $6 per MiB/s (8Mbps) per month.

[etaioinshrdlu]

I provisioned throughput on the EFS filesystem to the largest allowed value and still got crappy performance. Maybe it was the access pattern of the data, but large bulk file transfer performance was no higher than 100Mbit on a 25Gbit instance...