[upbeat_general]

Do you know of any good explanations of the techniques you used for those who only touch PyTorch Eager + occasionally torchscript?

[ipiszy]

You could check "AITemplate optimizations" section in the blog (https://ai.facebook.com/blog/gpu-inference-engine-nvidia-amd...), and https://github.com/facebookincubator/AITemplate#more-about-a.... The basic idea is to do aggressive kernel fusions.