A remarkably large number of the most notable of those people came from wealthy families - that’s what allowed them the single-minded focus, instead of worrying about food and healthcare.
And a lot of them suffered in poverty to pursue what they loved. Is there survivorship bias there? Sure. You don't become great without taking some chances though.