What do you mean by dwindling supply, we are talking about investors buying properties and renting them out. That doesn’t decrease supply in the rental market.
The thing is - quite often they aren't renting them out; but simply holding them as "assets". Or when they do rent them out - they tend to raise the rent. Which is why the supply of affordable apartments tends to "dwindle".