Stopping is a long way from "actively encouraging it and calling racist everybody who disagree" (and actively hide horrific stuff like the rape gangs).
I think the problem is creating an effective anti-immigration movement which does not have racial feelings running through the movement. It might just be impossible to do. When you wish to corral the votes you may have to accept the feelings of those who help you win.