[anthonix1]

Maybe get a 7900 XTX. 122 TFLOPS of BF16/FP16 for less than $1k and I'm getting 55.4% MFU

[sabareesh]

These are not apples to apple comparison, as this is running across GPU and much bigger model