Hacker News new | ask | show | jobs
by stavros 1568 days ago
Do you know if Restic supports block-level deduplication? I am backing up some database dumps and the backup filesystem has ballooned in size, even though the dumps are 99% identical every day. This makes me suspect that they only deduplicate on the file level, and that I would have some very significant savings if I zipped the dumps before backing up.

EDIT: Some details on deduplication are here, and I'm puzzled as to why my backups are so big: https://restic.readthedocs.io/en/latest/100_references.html?...
1 comments
XorNot 1568 days ago
Restics dedupe window is tuned to a 1mb boundary - it's optimised for cloud provider IOPS.

Bup with it's rsync sized one always did much better for databases for me.

link
stavros 1568 days ago
That's interesting, thank you. Do you have any info on how to enable that one?
link