Hacker News new | ask | show | jobs
by brchr 2911 days ago
It’s exactly the cutoff at zero that puts the "kink" into the function which makes ReLU nonlinear. :)