[bun-neh]

There was a paper not too far back that used SVMs in deep learning and leaped over the then state-of-the-art performance.

http://arxiv.org/abs/1306.0239