Hacker News new | ask | show | jobs
by slynux 4670 days ago
This looks interesting. Can be used for deduplication by keeping this hash table on disk for large amount of data

I wrote something like this to optimize disk seeks heavily by returning a reference of 8 byte and keeping a hashtable in memory. A mostly-append only records store that allowing mutations of same key and by rounding size of blobs by power of 2. Written to optimize storage layer for Membase.

https://github.com/t3rm1n4l/lightkv