[umanwizard]

Not a complete answer to what you're looking for, but you might find this dive into PyTorch internals interesting: http://blog.ezyang.com/2019/05/pytorch-internals/

[monadmancer]

This is actually very close to the flavor I had in mind.