https://medium.com/@yaroslavvb/tensorflow-meets-pytorch-with...
I've seen similar performance regressions on my own tasks and I don't have much to add beyond what's in that blog post.