if you allow each person to have 1-2 investment homes then you have the exact same problem but now it's decentralised and more people (more voters) benefit from the problem continuing to worsen
I mean that can be adjusted/tightened - you can say one to live in and one for rental and that's it. Other factors like other investment income etc can also be part of the criteria.