[Langdal]

Note that they only compared their solution with Eigen’s tensor transposition functionality. HPTT is not a drop-in replacement.

[wohlergehen]

Does anyone know how much time a typical TensorFlow model spends in transposition routines?

[pmalynin]

No hard numbers to present, but it would be beneficial in long-sequence LSTM networks, because TensorFlow has to do time-major <=> batch-major transposition between steps.