What's stopping them? There's tons of empty land in the world. Go find a stream in the forest and live a sustenance-level life. Oh, they want everyone else to be miserable too.
Perhaps you know this already, but they would be outcompeted very quickly and disappear (like the shakers). It’s like how paying extra taxes voluntarily isn’t a substitute for wanting increased taxation.
Wait a few decades and see if it exuberant growth ... What I think is that we might price natural resources much more expensively. Higher Price and thus growth is not always synonymous with more resources. It is an approximation but better means higher price not more resources.