|
|
|
|
|
|
by orf
1584 days ago
|
|
|
We had to move 300tb of EFS data into S3 in 40 hours, and this really showed how poor EFS performance can be. The reason was metadata only, which caps out at about ~40mbs. Raw rear speed is great, but any metadata ops cap out quite hard. We had to hack together a special NFS client to list the contents of the drive using as few metadata operations as possible, then have a separate step to copy the data. |
|
|