I don't understand why a city needs to keep "growing" to keep it alive. Keep the height restrictions because it keeps the city beautiful. Why don't we develop the parts that are run down before we screw up the view.
Because we live in a market economy. You build stuff where people want to be, not where you hope they'll go. Unless you don't care if your building stays empty.