Poor people are screwed up regardless -- if rates are high, they can't afford payments, if rates are low, prices rise and they still can't afford payments. Not to mention getting downpayment.
The down payment is the hardest part. "Just barely able to make payments" people are better off when rates are high because that depresses prices resulting in a lesser dollar amount for whatever the down-payment is.
Homes come in a lot of shapes and sizes though - in Italy where I lived for a number of years, it's pretty common for people to live in a flat in a 4/6/8/whatever unit building, either as owners or renters.
Depending on where demand is, I'd expect more of that sort of thing too, if it's allowed. In the US, it is forbidden to build those kinds of homes in large areas of our cities.
Here is the graph for multistorey apartment buildings. I'm not smart enough to interpret what this means. In the big city I live in in Denmark, most new apartment buildings are luxury apartments and expensive as hell, so I don't think they are a result of rising house prices.
For poor people it means that your rent continues to rise, house prices become further inflated and you will still pay massive interest rates if you get a consumer loan.
On the other hand, the banks are basically transferring wealth to the middle class (or anyone who can afford a mortgage) by paying them to borrow money.
Workaround: don't be poor.