Hacker News new | ask | show | jobs
by hilariously 43 days ago
The prefixes are not meaningless, they are performance boundaries as well if you read the docs.
1 comments

Good point, prefixes are performance boundaries too, per-prefix rate scaling means you can spread load across prefixes to get aggregate throughput well above 3.5k RPS [1].

But that's a different thing than what the post is about. Even teams that use prefixes for performance don't have an S3-native way to ask what a prefix represents, who owns it, whether it's still accessed, and so on. The semantic layer is missing whether you're hashing for throughput or just laying data out the obvious way.

[1] https://docs.aws.amazon.com/AmazonS3/latest/userguide/optimi...

Absolutely right and if I disagreed with any other point I would have said something, a very solid post about metadata in general I just dont want people to ever leave with a "oh well we can just put it in one prefix because it MEANS the same thing" because that way is slow and bad.