Yeah, the worst lecturer I ever had was a maths genius. I remember on one occasion someone asked a question and the best he could do was "but that's trivial".
I had a multivariable calc prof who used one of those overhead projectors and would spit on the projection as he lectured. He was also pretty hostile to the students.