[antisthenes]

The social penalty is called opportunity cost in Economic terms. These men generally don't have big social networks that could have gotten them jobs in the first place, so there isn't much lost when they isolate themselves.

For women, losing their social network is losing a large chunk of their safety net (if they aren't receiving welfare otherwise), so it's almost unfathomable for them to do so of their own accord.