Moving is a burden of a highly varying degree. The implication that it is a non-factor points to a fundamental absence of shared experience between you and the people you are criticizing.
I have moved significantly more than the average person to do exactly what I’m talking about here. Without money, with money, without kids, with kids. I feel like I have a pretty reasonable amount of experience.
It’s not that bad.