If you want to argue that some spoken words can be prosecuted in some jurisdictions, chose another opponent. I state my personal opinion that anything spoken should be protected under free speech rights, and even the death threats. Yes, because words do not kill. Killing requires action, and actions must be stopped, not screaming.
You didn't say "shouldn't be a crime" you said "is not a crime". And I'm not saying that words directly kill. I'm saying words have their own power that can absolutely hurt. Speaking words is an action and it can cause harm.
Politicians can declare anything a crime, and same act can be legal and criminal in places spaced 2 meters apart, that's why there is no point arguing about that. Regarding speech "crimes", see my earlier comment about Putin's Russia.
Thus, sane people MUST fight against criminalising any kind of speech, because speech is not a crime. Just like sane people fought against slavery, segregation and Holocaust, all of which were legal.
Are you of the belief that words can never hurt? It wouldn't bother you to have a crowd of protestors making untrue accusations about you loudly and vocally, where your family and employers could hear, ruining your reputations and relationships?