Hacker News new | ask | show | jobs
by SpinyNorman 3188 days ago
Scaled-ELU is meant to create self-normalizing nets, but that's nothing you can't achieve a bit less efficiently with explicit normalization (batch norm, etc), so hardly a game changer.