But they are similar in that some people believed it precluded others from doing their jobs (indeed maybe even being a part of society) if they engaged in the behavior. You may not like the analogy, but it works.
You should talk to an older person from eastern europe, where believing in communism is (rightly) seen at the same level as believing in nazism (and in absolute numbers it actually harmed more people). Then you can reassess your comparison.