Hacker News new | ask | show | jobs
by CamperBob2 827 days ago
The various sigmoid activation functions have the effect of keeping bit growth under control, by virtue of clamping to the +/- 1 range.