[ivansavz]

Very nice idea.

What is the objective function (loss function) that `back_propagate` is optimizing exactly? I'm new to the world of NN, so really excited to see NN code that works from first principles. Reminds me of https://github.com/mnielsen/neural-networks-and-deep-learnin...

Perhaps a little more detail about the math behind the code would be in order? I'd be happy to help out.

Another cool direction would be to convert the python code to cython and see how much faster it will run...

[wyliec]

Cheers for feed back. The cost/error function is simply the 1/2(a-y)^2 ...(I think its called the square cost function). I wrote all the code myself (no libs) so people like yourself can see all steps required to train an ANN. I was thinking of getting things working for GPU, which should even make cython look slow. All depends on how much attention I get. Right now it's still got quite a few bugs, and in general is under done.