[sleepytimetea]

It would be interesting to see the performance of protobuf vs Parquet in this case...not sure if DuckDB supports that...

[denny_c]

Parquet is a columnar format with columnar compression. With metadata and indexes. In many cases it needs to read a tiny fraction of Parquet file. Protobuf has zero chances.

[LunaSea]

Not yet, but I believe that Click house does.

Avro would be another contender in the space.