I’m currently vacationing in super hot Tokyo, and yes, those buildings do create shade when packed around narrow roads. I get that in the USA where buildings are spaced so far apart from each other that this wouldn’t be very effective.
Concrete buildings you mean, and even then, new ones are insulated well enough to not trap heat like pavement does (otherwise they couldn’t be cooled on the inside very effectively).