[shoyer]

To be more precise, in backwards mode auto-diff, inputs only need to be saved if they are used in a non-linear way.