Yes, though the truth of your statement doesn't detract from the truth of my statement. We can't change our gender or race but we can change our outlook.
The problem here is that "outlook" hardly does justice to a very complex situation.
The implication that oppressed peoples who have been genuinely wronged merely need to put on a happy face and change their attitude is pretty horrendous. It ignores the fact that smooth social skills take time and opportunity to develop. It ignores the fact that if you are "the wrong kind of people" you do not get the benefit of the doubt that "the right kind of people" get. (This is a thing I have gotten to experience firsthand from both sides of the equation. Being homeless has been a huge education in just how much that benefit of the doubt greases the wheels of polite society. When that lubrication is missing, your life can grind to a painful halt.) And a thousand other factors here.
I am a woman and I try to tell other women what they can do differently in the face of living in a sexist world. I am routinely accused of blaming the victim for trying to empower women. I find that very frustrating because I do my level best to provide solid data and practical how-tos. I do my best to avoid suggesting that women merely have an attitude problem.
So while I am sympathetic to the idea that wherever you go, there you are and I am also sympathetic to the idea that it makes vastly more sense to focus on changing the things within your own control, given the larger context of life, I think this point you are trying to make about "just change your attitude" is a really crappy message to put out there. It is akin to telling someone maimed by abuse "It's in the past -- it doesn't matter!" and overlooking the very real legacy of impairment those past actions have left behind.
We can change the environments we participate in to correct for measurable bias, though, and it is reasonable for people being discriminated against to expect us to.