Then go. If the price of having them here is that they get to not pay their fair share while taking advantage of our infrastructure and workforce, they can pound sand.
I'm not concerned with people with that little money. If you've got $10M, you're rich, but you're not part of the problem rich. The three walmart heirs are worth $180B between them. Jeff is worth that by himself. This isn't "being good at business" it's hording. I'm concerned with Billionaires. 800 people who control $3.4T in assets. I don't want to make them poor, I am completely happy if they remain obscenely rich, but you just can't have that much of the pie.
Maybe if we can all agree on a number then we can figure out how best to collect it.