[paul_mk1]

Comparisons between different chip architectures are imperfect. In our opinion the most fair thing to do is 1) match the TFLOPs (since these workloads are compute bound), and 2) find a similar card that can run the same size models. Since MI210 has 64GB, the closest one is the A6000 with 48GB. Many of the less expensive ADA cards can't even fit a 13B model in VRAM, so a comparison could not even be made.

[hereme888]

Oh I get it: you're matching compute hardware capability to test the performance of your software. Thanks! (and good job!)

[nnevatie]

I have an Ada 6000 installed here. How can I test this?