Hacker News new | ask | show | jobs
by thatguysaguy 903 days ago
This only lists first moments, but Adam stores estimates of first and second moments.
1 comments
furiousteabag 903 days ago
By default, SGD w momentum is enabled as optimizer. You may try selecting Adam and it will list second moments as well.
link