Hacker News new | ask | show | jobs
by rwaksmunski 366 days ago
Common Crawl delivers the data as bz2. Indeed I store intermediate data in zstd with ZFS.