In response to your original comment, I believe there's also a desire to punish people for having premarital sex, as evidenced by right-wingers' strong opposition to emergency contraceptives.
I've never had a conversation with a person who was broadly anti-abortion and anti-subsidized-birth-control that didn't end with the explicit impression that they feel disgust for people who have sex before marriage or for reasons other than reproduction, and that the primary notion upsetting them is the idea of their taxes going toward those people in any form. It's clearly a notion born out of the popular and too-eagerly-applied idea of "bad" people who "deserve" consequences.