Hacker News new | ask | show | jobs
by saulpw 39 days ago
> Also, my main gripe with parquet (single table per file) is not even addressed, so, also the name is a bit hyped up.

When I was working with parquet, I imagined a .parquetz file format which was just a zip file containing any number of uncompressed parquet files. So you could sling multiple tables around in a single file, and still use range requests to access them.

1 comments

tarquet?
Cute name, but alas .tar is not random-access. The .zip format seems to be uniquely simple, ubiquitous, and random-access even for huge files.