https://www.thefp.com/p/google-memo-james-damore-vindication...
Basically he has kept a very low profile.
It would explain the early retirement + lack of work history.
But yes, family money is also a possibility.