|
|
|
|
|
by powturbo
1021 days ago
|
|
Sorry, a digit was missing, but now
https://github.com/powturbo/TurboBench/issues/43 Well, a correct benchmarking is not done with special data, but with datasets that represent a large set of distributions. Such datasets are for ex. einwik8/9 for text, silesia for a mixed dataset.
As a corner case example, RLE-compressible data is not representative for benchmarking compression libraries. If you provide a link for a dataset 10-100MB, I can verify your claims, because I'm not aware of a dataset where igzip is 2 times faster than libdeflate. In TurboBench there is no I/O or other overhead involved, additionally it's single threaded.
It's also possible that you're comparing two different CLI programs, one (igzip) I/O optimized and the other as a simple CLI. |
|