Slight inconveniences most likely. If you commute by bike, you then need to carry the helmet around with you or risk it being stolen. You have helmet hair, which sounds trivial, but might be an issue for some people riding to work and such. Things like that. Nothing huge that I can think of, but I'm sure these things discourage cycling to some extent, for some people.
Forget the theories and look at the data. When governments (such as Australia) have passed laws making helmet use mandatory, bicycling rates have gone down.