Hacker News new | ask | show | jobs
by 6gvONxR4sf7o 907 days ago
> Julia was ahead of the game with automatic differentiation which took a few years for Python to get support.

In what way is this true? Looks like Julia didn't exist until 2012. If I remember correctly, theano was the big AD thing in python at that point.
1 comments
notthemessiah 907 days ago
Theano existed, but it didn't use autodiff at the time, most loss functions had preprogrammed derivative functions. Python first had native autodiff in June of 2013 with the ad package, but previously had bindings to Fortran and C++ libraries that supported autodiff in different use cases. Julia first had native autodiff in April of 2013 with ForwardDiff.jl.
link
6gvONxR4sf7o 906 days ago
It seems overly nitpicky to differentiate (no pun intended) so much between forward mode AD with DiffRules and theano's specific flavor of symbolic differentiation, but I'm no expert there.
link