[eivarv]

I'd say that the problem seems to be that any attempt at rational discussion inevitably leads to talks of "us" vs. "them", culture war, conspiracy theories and propaganda akin to "The Protocols of the Elders of Zion" (including "Eurabia", lying to kafirs, etc.), the negation of moderate muslims and integrated immigrants, stereotypes and generalizations, misrepresented statistics and basically fear mongering dealing with the supposed invading hordes of savages.

The average Joe not being able to tell "racist" from "xenophobe" seems kind of trivial in comparison.