|
|
|
|
|
by benwills
513 days ago
|
|
If anyone is interested in an example of how ZSTD's dictionary compression performs against standard gzip, a number of years ago I put together an example using some Common Crawl data. "I was able to achive a random WARC file compression size of 793,764,785 bytes vs Gzip's compressed size of 959,016,011" [0] In hindsight, I could have written that up and tested it better, but it's at least something. [0] https://github.com/benwills/proposal-warc-to-zstandard?tab=r... |
|