Which state do you live in that penalizes you? Federally, you'd have to have a combined income of almost $700k for filing jointly to be a penalty and even then you don't have to file jointly.
My assumption would be that they're talking about implicitly penalizing single folks via the tax code rather than married couples. There are only two reasons why I would get married:
1. Tax benefits (discussion here)
2. Children