I was one of those who took an SSRI and had a change in my sex drive. I took escitalopram and it killed my sex drive, doc switched me to trazodone and things returned to normal.
If your SSRI is causing you problems, talk to your doctor, they can switch it up. Everyone responds differently, you should be able to find one that won't mess with it.
To enjoy sex, or to even have a sex drive, you have to be not taking anti-depression medication. Maybe it's the rise in depressed people[1]?
----
[1] I am one of that number, and take meds, and suffer as stated.