I don't see anyone from the suburbs demanding to demolish Manhattan and turn it into farm land. Likewise I wouldn't demand to have housing built for me in a specific town instead of living elsewhere.
Maybe because that's where the best jobs are. Maybe because that's where they're from and it's not their fault they're getting priced out (gentrification). Maybe because they just really like the place. In any case, you don't get to be a gatekeeper. Cities are public.