It seems more democratic than a majority deciding for everyone, if each person decides for themselves whether to avoid or not.
At least with a ballot, your vote is a secret.