[hawkjo]

Yeah, you got it. Building numbers—banchi blocks—label the age of the building, not its position in space. The only people for whom many addresses are physically findable seems to be people from the neighborhood who have memorized the arbitrary number of each building. Google maps is a blessed thing generally, but an absolute godsend when visiting Japan.