[yabun]

Deep learning has really only recently become successful with new learning algorithms such as constrastive divergence and convolutional neural networks. Previous efforts were focused around backpropagation, but due to the signal loss across many layers there was never enough information in the output layer to successfully train the network.

[seiji]

Time for a fact update! My, my, how time flies.

Deep learning has really only recently become successful

hinton coined the term "deep learning" around 2006/2007 (more around deep belief nets/RBMs, but still, same thing), if that's considered "recently."

constrastive divergence and convolutional neural networks.

CD was also ~10 years ago. CNNs were reading your checks and postal zipcodes in the mid 90s.

successfully train the network.

In the early 90s, RNNs were driving cars on highways using only webcams under basically VFR. No giant sensors, no LIDAR, no GPS, no mesh networks, just camera input.

[nl]

The 2012 ImageNet results were what really launched the current interest.

Before that there was little evidence that any form of neural network was massively better than other forms of machine learning. Now it has become clear that isn't the case.

[simonhughes22]

Is this Jurgen? :)