And likewise, it's hard (though I guess not impossible) to achieve that Zen when you can't afford food or shelter. Maslow's hierarchy of needs and all that.
I understand what you say, the world is not fair and some of us, including me, have started from zero and should have basic needs in our life.
However, I don't think spending time, for instance, 30-60 min a day for things we love to be hard
I call myself constant learner, some years ago I said if Japanese people improved their country through small changes rule (10 min a day) what if I spend 1-3 hours a day for things I really love to follow?
Also read this book [1]: Linchpin: Are You Indispensable? How to drive your career and create a remarkable future