Veganism is a spectrum. Some are fine with honey, others find it exploitive. The interesting thing to me is the principle that is so important to warrant a conspicuous lifestyle change and how it maps to other issues.
I think the most common goal of vegan or vegetarian diets is to reduce animal suffering, not to eliminate any part of your life that is even adjacent to animals. As you've pointed out, the latter would be impossible.