Hacker News new | ask | show | jobs
by Onavo 540 days ago
> Ok how the hell do we train this thing? Stochastic gradient descent with back-propagation won't work here (or if it does I have no idea how to implement it).

What's wrong with gradient descent?

https://snntorch.readthedocs.io/en/latest/

2 comments

Thanks for sharing. I thought the discontinuous nature of the SNN made it non-differentiable and therefore unsuitable for SGD and backprop.
Lol in differentiable programming they usually hard code an identity for the problematic parts (e.g. if statements)
Gradient descent needs a differentiable system, the author's clearly not.