|
|
|
|
|
|
by def-lkb
826 days ago
|
|
|
Compression, synchronization and backup systems often use rolling hash to implement "content-defined chunking", an effective form of deduplication. In optimized implementations, Rabin-Karp is likely to be the bottleneck. See for instance https://github.com/facebook/zstd/pull/2483 which replaces a Rabin-Karp variant by a >2x faster Gear-Hashing. |
|
|