[magicalhippo]

I struggled as well to find a solid thread or argument.

It seemed to all boil down to trying to justify why it's not wrong of him to cheat on his taxes and play loud music in the park at night:

We don’t have to think about what is good for the “society” or for people at large, We only have to care for people that are around us.