Hacker News new | ask | show | jobs
by qbit42 391 days ago
Loss landscapes can be viewed as manifolds. Adagrad/ADAM adjust SGD to better fit the local geometry and are widely used in practice.