In the words of Benjamin Disraeli
"Yes, I am a Jew, and when the ancestors of the right honorable gentleman were brutal savages in an unknown island, mine were priests in the temple of Solomon"
It's not. It's maybe even worse than racist, because most of Disraeli's ancestors probably weren't even members Solomon's kingdom, they likely were mostly Europeans who converted and then adopted the ancestry.
Why is that relevant to if the statement is racist? Yes there is a difference between kicking someone when they're down and kicking while down, but it is still kicking.
And in case anyone hasn't heard: There's reasons pride has been considered a sin. There's nothing redeeming about the emotion of pride. You can have pride in your belief about your ancestors or pride in your accomplishments. Either way, pride is not doing anything positive. There are healthier ways to feel positive about things, and pride can go the hell away, period.