You don't need to "feel" something towards poor people to advocate in favour of them. It is practically impossible to really feel anything for people who are not in your very inner personal circle. But trying to help society progress and reduce inequalities is a net benefit for everyone.
I don't care about poor people either. All I care about is a system that sets everyone up for success. I know it's possible and I know it would help poor people, but we aren't there yet.