exclusion != racism. Racism has power dynamics associated with it. If exclusion (or special inclusion programs as I would call it) leads to a more racially and gender balanced community it is a good thing.
Whether or not something is good has nothing to do with what it's labeled. Sure by definition it might not be racist but certainly that's how it would play out. A better equation might be:
exclusion != racism ≡ you're a minority