That you assume I'm privileged because I want a more peaceful society suggests you will constantly seek to divide and set social groups against each other for the sake of some personal satisfaction.
But saying that we "let politics be politics" is a privilege. If you are in a minority, either by choice or by birth, it's not that simple. Standing up against discrimination and making that one of our core beliefs should not be as controversial as you make it out to be.
And it's great for you that you can just keep politics in "political space", go home and live in peace. But others can't turn racism they experience off. I would highly suggest watching this video of a psycho-social experiment [0].