This is mostly a Western-centric view, as there were lots and lots of cities in the Muslim/Ottoman world (just to give an example) with no walls encompassing them whatsoever.