Nominally free lower classes would have lived in an entirely different part of town. We know quite a lot about the society in question from written sources, this is far from blank slate archaeology (where everything we find seems to default to "used for some ceremonial purpose")