The tax cuts weren't just for the wealthy though. You're basically just doing the Buffet-rule by only removing Bush tax cuts for the wealthy. Not going to help much.
I never implied the rich didn't disproportionately benefit or you couldn't end the Bush tax cuts and help the poor at the same time. However, the net effect of that new tax structure wouldn't help the economy much, and therefore wouldn't help tax revenue.
Plus, the idea that ending the Bush tax cuts and giving a break to the poor are mutually exclusive is a false dichotomy. The power exists to do both.