Hacker News new | ask | show | jobs
by m0zg 1692 days ago
Might as well try Arrow Feather, there's an R binding for it. This Flatbuffers-based format can be memory mapped and it requires very little decoding. Super fast and light on resources.

Also, Parquet supports different encodings, some of which may be faster, denser, and/or consume less RAM, or all of the above.