|
|
|
|
|
by cogman10
668 days ago
|
|
CSVs are bad. If you can change the format then don't use a DSV, use parquet and a library for your language to consume parquet. It's less code for you and you can do neat things like zstd compression on the columns. Bonus, it also doesn't require that you load and unload everything in memory. https://arrow.apache.org/docs/python/parquet.html |
|