I think part of what makes people skeptical is that even if there was no anthropogenic CO2 in the atmosphere, there would still be these so-called "freak events". There were big hurricanes in the US's Revolutionary War era, for example, that had huge impacts on naval forces in the Caribbean. If climate change truly was a total hoax, believers could still point at a myriad of extreme weather events and say "look, climate change is real".