And there are plenty of people who can still be liked, or appreciated at least, who also were racist and misogynist, or whatever other moral defect you like. It's okay to show affection for someone who didn't perfectly fit the strictures of what a specific type of virtue signalling labels as correct.
On the contrary. My worldview has been and still is shaped by an ever changing learning curve of the world's nature. That includes being flexible enough to show some affection even for that which doesn't fit rigorous dogmas of conduct. Can you say the same about your labels?