I can't offer any advice, but as an user, I urge for features not to be removed due to a lack of engagement, as was done for Firefox's "compact mode" for some time. I think they might have reversed that change.
Good point! Talking to some of the users of the feature you're about to remove is probably a good first step. Do those users use the feature in a way that's aligned with your product strategy?