At least with Arch, it's an optional package: https://archlinux.org/packages/extra/x86_64/xfce4-whiskermen...
I don't know how to tell if this is the case for Ubuntu/Debian just from browsing the package pages in launchpad.