Hacker News new | ask | show | jobs
by s_tim 759 days ago
How does this compare to Enzyme (https://enzyme.mit.edu/)?
1 comments

Enzyme is traditional, but super duper optimized, autodiff, that is, it returns the partial derivatives for one path taken through the program, ignoring other branches. DiscoGrad captures the effects of alternative branches. What's special about enzyme is that the gradient computations benefit from LLVM's optimization passes and language support.