It's worse than that though, because, for example, nuclear power is significantly safer than other technologies currently in use[1][2], and as another example, immigrants (including illegal immigrants) are less likely to commit crimes than native-born citizens in the United States[3][4], at least for several generations (they asymptotically approach native levels).
So I think we're fighting a couple of battles here: fear-mongering and misinformation/ignorance, and I guess they go hand-in-hand.