[nomadluap]

At that point just start using an SQLite database as a data format.

[jonstewart]

SQLite is a row-oriented store, not a column-oriented store, ie, there are fundamental tradeoffs between the two.

[cm2187]

But sqlite has no compression by default.