I think it only really became a debate once a popular idea spread around saying that wearing a mask is to protect others from yourself. Before that, mask wearing seemed a little bit selfish or paranoid, but that idea turned it into a moral action. And morals give people a feeling of rightousness in judging others and fighting against them. Then when people start fighting, others find themselves in the position of enemy so they fight back out of indignation.