The decreased wealth of occupants is the entire source of the landlord's increased wealth when rent increases, are there really people who will argue that isn't the case?
I guess purely logically, you are right. But I would be against the underlying theme behind that general type of thinking. If you take that line of thought and extrapolate it, it starts getting close to a socialistic/anti-economic progress point of view.