Now obviously having a hat land on a windshield and actually block visibility would be worse, but catching something falling out of the edge of your vision especially something odd like a falling hat would easily qualify.
It’s also distracting pedestrians and so likely to result in other injuries.