Hacker News new | ask | show | jobs
by billconan 3093 days ago
"working on compilers for imperative differentiable programming languages"

what would be an example of such language?
3 comments
sedachv 3093 days ago
Common Lisp without any changes: https://people.eecs.berkeley.edu/~fateman/papers/ADIL.pdf

Fortran with some changes required: http://www.ens.utulsa.edu/~diaz/cs8243/adifor.html

C with some changes required: http://www.ens.utulsa.edu/~diaz/cs8243/adiff.html

link
seanmcdirmid 3093 days ago
BrainScript was one, though it seems deprecated ATM:

https://docs.microsoft.com/en-us/cognitive-toolkit/brainscri...

Compilers might not be involved, interpreters can work just as well if most of the heavy lifting is in the solving.

link
currymj 3093 days ago
working with dynamic neural net libraries that have autodiff (PyTorch, regular Torch, and I think also MXNet now) feels a lot like this. you just write normal functions, but after you execute them you can ask for gradients too.
link