That's only a result of the resources made available by the inhabitation of rural lands being under-valued on the market due to subsidies. Say goodbye to affordable food prices if we don't subsidize rural locales.
If you have to subsidize something, you only want to subsidize as much as necessary. Farmers can get their subsidies. A remote worker moving out of SF with a fat paycheck doesn't need the subsidy.