I'd much rather it be the playground of the lucky, than the playground of the rich. Public lands are held in common trust in the name of all citizens equally, not in proportion to their wealth. If there's not enough access time to go around, then a lottery is an obvious way to approximate equitable access.
You can do it as a day hike from the Mitre basin to the south. I was there in Sept, no people, amazingly beautiful. Send me an email (see profile) for details.