|
|
|
|
|
by aras_p
1150 days ago
|
|
I can't comment on the linked github issues, but looking at the turbopfor icapp.c sources, it looks like the blosc2 bytedelta is not used correctly there: the expected order is "shuffle, then bytedelta", but icapp.c does "bytedelta, then shuffle". That might explain the poor result you get :) |
|
I've now reverted the order to "shuffle, then bytedelta". It looks better but still inferior to TurboPFor floating point compression and is also 35% slower in decompression.
TurboPFor FP with lz4 instead of zstd,15 has similar ratio than blosc+bytedelta+zstd,15, but again it is a lot faster.
Please, publish the exact numbers of your survey at least those with zstd,15. The zfp results in my benchmark don't look good. Are the numbers similar to yours?