[iandanforth]

Hinton's team (SuperVision) uses an interesting 'dropout' technique. He gave a Google Tech Talk on this back in June.

http://www.youtube.com/watch?v=DleXA5ADG78&feature=plcp

And an older talk that covers some of what a deep convolutional net is:

http://www.youtube.com/watch?v=VdIURAu1-aU

[modeless]

Hinton is currently teaching a Coursera class on neural nets: https://class.coursera.org/neuralnets-2012-001/class/index

So far I've watched the first lecture and it seems like it'll be exactly the course I've been wanting: starting with the basics of machine learning but quickly diving into the state of the art for neural nets.