I've heard this assertion many times. But after having ridden hundreds (thousands?) of hours wearing headphones, I must conclude that it's a perfectly fine idea. People believe headphones will obstruct your hearing. Some do. Some don't. Wear the ones that don't. It's also possible to set the volume to the same level that it would be from a set of handle-bar mounted speakers.