[bonoboTP]

Convnets follow pretty naturally from multilayer perceptrons. Perhaps backpropagation was a breakthrough, enabling the training of ANNs on data, instead of hand-tuning.

But the idea of neural nets is very old, going back to Rosenblatt and connectionism.