Hacker News new | ask | show | jobs
by yingw787 2145 days ago
I wish Excel / Google Sheets supported Parquet export. I've worked with CSV files and Parquet files and found the latter a vast improvement. Chunking data is trivial, you have fixed-size data types, and existing types are well-supported across a multitude of frameworks.

In comparison, CSVs are pretty much unstructured text files with added suggestions.

More pipelines should natively support Parquet files, or something like it, and have a thin CSV to Parquet conversion layer on top.

P.S. I'd love to create a Parquet file visualization tool (something like https://github.com/in3rsha/sha256-animation) in the near future.