Y
Hacker News
new
|
ask
|
show
|
jobs
by
alfalfasprout
2145 days ago
I just did some benchmarks and it's pretty similar for small files. The difference would only be noticeable if you're serializing a ton of small files.
1 comments
lsorber
2141 days ago
Huh, makes a pretty big difference for us. We were using pandas' built-in to_parquet though, which seems to suffer from some overhead.
link