Hacker News new | ask | show | jobs
by FridgeSeal 40 days ago
> logs, media, ML artifacts, raw dumps, etc., none of which fit into a table format.

You would be appalled at the kind of stuff I have seen teams stuff into parquet and iceberg tables.

1 comments

Ha. The fact that teams reach for iceberg to organize things that aren't really tables is itself a symptom of needing better management tools for other types of data.
Sure, but that’s not an S3 concern, because the vast majority of people use S3 as it is, without needing additional management machinery.

The solution is just to spin up the machinery you need for your solution, rather than making S3 cover all possible bases.