Y
Hacker News
new
|
ask
|
show
|
jobs
by
iwd
959 days ago
Do you have compression enabled? At least from Pandas, Parquet defaults to compressed and Arrow/Feather default to uncompressed. When I enable zstd compression, I get similar file sizes, and sometimes Arrow is smaller.
1 comments
slt2021
959 days ago
I was just trying pandas native .to_parquet and .to_arrow() without any extra config knobs
link