Biggest problem in the sense of making them oh-so-hard-to-resist? Otherwise I would have thought their biggest problem is emissions (CO2, and particulates for diesels...)
It's that second runner up is massively less convenient...The reason why certain addictive drugs are so bad isn't how they make you feel, or what they do to your body friends and family, it's because they're damn hard to stop using.