Hacker News new | ask | show | jobs
by suki 5362 days ago
Geoffrey Hinton "Next Generation Neural Networks"

http://www.youtube.com/watch?v=AyzOUbkUf3M

-It is more biologically plausible then any other NN algorithm I've seen

-It results in creativity (in the video he has the computer "imagine the number 2")

-It pretty much explains why we need to sleep/dream. The network has to be run both forward (accepting sensory input) and backwards (generating simulated sensory input) in order to learn

-It emphasizes the point that the brain is NOT trying to do matrix multiply (or any other deterministic calculation) with random elements (if it was trying to be an analog computer it would be). The randomness is an essential part of the algorithm.

1 comments

I agree. Hopfield networks, of which Hinton's Boltzmann machines are substantial elaborations, have many human-like properties:

-can fill-in details as a result of noisy or missing input -can sometimes "see" patterns in random noise