Creating a false equivalency between intolerance of the intolerant and intolerance of others / other groups is a key rhetorical device for fascists.
Even if you've walked to this position through "logic" and a concept of perfectly spherical human beings [0], with no steps through fascism, you should be aware of how this position is used by fascists to give themselves a veneer of rationality while painting their opponents as irrational.