Hacker News new | ask | show | jobs
by iwd 959 days ago
Do you have compression enabled? At least from Pandas, Parquet defaults to compressed and Arrow/Feather default to uncompressed. When I enable zstd compression, I get similar file sizes, and sometimes Arrow is smaller.
1 comments

I was just trying pandas native .to_parquet and .to_arrow() without any extra config knobs