Hacker News new | ask | show | jobs
by mtrimpe 4394 days ago
After watching 'Recent Developments in Deep Learning' by Geoff Hinton [1] a while ago I did come away believing that there does seem to be quite a bit of untapped potential in deep neural nets.

Do you feel that talk is overly optimistic/misleading? Or just that you don't think there's that much money to be made with it?

[1] https://www.youtube.com/watch?v=vShMxxqtDDs

1 comments

I've also seen that talk. In many cases I think the advantages which may be had from deep learning are likely to be marginal - a few percent improvement over the next best algorithm. Multi-layer neural nets already existed for a couple of decades, and deep learning is really just a refinement on that, making the training process faster and more robust to overfitting.
Do you know of any other system that gets ~14% error rate on the IMAGENET dataset? The next best system as recent as 2012 was doing ~26% error. That is a pretty big gap, especially considering IMAGENET is a million image data set. (btw did not see the talk)
> especially considering IMAGENET is a million image data set

... and that human error rate is also > 0. Sometimes machine learning bests the humans.