Hacker News new | ask | show | jobs
by simsla 394 days ago
Avoids vanishing gradients in deeper networks.

Also, most blocks with a residual approximate the identity function when initialised, so tend to be well behaved.