We live in a society where this issue affects women way more than it does men (see Clinton getting lectured at about not constantly smiling). Bringing this up is part of a fight to reduce systemic bias.
I get that and generally agree. I am more challenging the idea of feeling bad / guilty about sexual attraction, which I interpreted as being implied by some of the other comments in this thread.