I recently came stumbled upon this autodiff in two dozen lines of python: https://github.com/breandan/picograd/blob/main/picograd.py