Well the logic certainly isn't supported by data. Most homeowners have no problems allowing cars to drive around their neighborhoods, despite the fact that cars have dangerous emissions that kill thousands yearly, not to mention inattentive drivers who cause thousands of wrecks annually.
That's because it's their own cars. The same people will complain about a burn ban during a dry summer, because it's their own yard waste they want to burn. But you want to put a developmental group home in the neighborhood and they freak out. There's no sense to it, just egoism.