[dhruvdh]

Which algorithm you pick for what shape of matrices is different and not straightforward to figure out. AMD currently wants you to “tune” ops and likely search for the right algorithm for your shapes while Nvidia has accurate heuristics for picking the right algorithm.

[0-_-0]

Nvidia's heuristics are not accurate, and it's not possible to achieve peak performance without search.