I’m not sure you’re disagreeing with me: Those who owned the land and didn’t have to migrate / soldier around or work someone else’s land to survive were doing well for themselves!
The people farming didn't really own the land, in many cases they were captured or corralled in place and forced to farm. The were also forced to dig canals and occasionally do the soldiering. All of the early Mesopotamian city states use corvée labor. Being an early farmer was super shitty, and no one did it by choice.