Basically American cities stopped growing at a rate sufficient to handle the boom in people in the mid-late 20th century. Now there is huge demand on cities to house people affordably but the entrenched powers that be in these areas prevent the necessary development through tools like zoning or bureaucracy.
The whole system is basically fucked. Sigh.