There's a difference between "not politically-loaded decades ago" and "not politically-loaded now".
We still let people use the Swastika if they had a harmless tradition of using it beforetime. But if anybody new uses it, we assume it's because of the murder.