False equivalency. Even taken to extreme ends nothing here can be construed as suggesting "only the wealthy" should be allowed or able to drive.
The moment someone suggests enforcement of a law someone comes running in yelling about how it's regressive and will disproportionately affect the poor, and by extension "only the wealthy" will be able to do whatever.
Everything disproportionately affects the poor because it's very hard to be poor.
And the moment you say we shouldn't enforce laws because it will make poor peoples' lives harder you are saying that something is no longer a privilege. That poor people should be able to break the law with lesser or no consequence because they are poor.
I don’t agree with making driving something only the wealthy do, though.