Hacker News new | ask | show | jobs
by rwdim 2039 days ago
What’s the latency with 100,000 and 1,000,000 files?
1 comments

We haven't run mv/list experiments on 100,000 and 1,000,000 files for the blog. However, We expect the gap in latency between HopsFS/S3 and EMRFS would increase even further with larger directories. In our original HopsFS paper, we showed that the latency for mv/rename for a directory with 1 million files was around 5.8 seconds.