Keep telling yourself that. I'm sure you'll still be thinking that at 80 when you look back at whether or not your life meant anything anyone after you would give a shit about. Money doesn't mean shit when you're old and alone. My family also has "fuck you" money; don't think retiring at 40 overawes me. Beyond a certain point, it doesn't hide being an asshole.
When you go to work, you trade your identity to be the person that earns as much as possible. Everything else is just noise.