[surganov]

See also: Hacker's guide to Neural Networks

http://karpathy.github.io/neuralnets/

[najarvg]

+1 for Karpathy's guide. It's a mini-book - hands-on, extensive and guided by his personal philosophy of knowing all the nitty gritty math details so you know how to optimize your scripts even if you use many of the available libraries