I'd weigh lifting 100's of millions of people out of extreme poverty as much more morally important than avoiding stagnant American middle class wages.
But what if we could lift 100's of millions more if the american upper class contributed more. It's not that the task isn't worth doing but if that is the point, we should all be choosing to do it together.