Hacker News new | ask | show | jobs
by ysleepy 699 days ago
I wonder why ZFS is marked as not having de-dupe (deduplication).

AFAIK ZFS has had deduplication support for a very long time (2009) and now even does opportunistic block cloning with much less overhead.

3 comments

ZFS online deduplication is not comparable with on-demand dedup offered btrfs and xfs and is prohibitively expensive for many workloads.

The new block cloning still had data corruption bugs quite recently.

>ZFS online deduplication is not comparable with on-demand dedup offered btrfs and xfs

But it has de-duplication, with your logic no non-CoW FS should be in that list because they are not comparable.

It is still deduplication.

Chart should have a bloc dedup and file dedup separated columns if it is deemed non comparable.

Also XFS has deduplication now, already for some time, at least one year or two.
btrfs has deduplication as well.

In theory full file deduplication exists in every filesystem that has cow/reflink support

fclones for example covers it well for any filesystem with reflinks:

https://lib.rs/crates/fclones

fclones group |fclones dedupe

Yes I sort of skip-read a lot of it after that.