[dlcarrier]

I'm using an MI25, flashed as a PRO WX 9100, which requires an older version of ROCm to work. That's expectedm, because my GPU is depricated in future versions of ROCm, but what irks me is that everything neural network related barely works. You need the exact version of every interpreter and library, which ends up working on some distributions but not others. I've noticed that when people program in compiled languages, they seem to make a concerted effort to do some kind of bounds testing, but anything in Python or Node.js seems to be released as soon as it kind-of-sort-of works, some of the time.

[technoabsurdist]

oh yeah, in my experience anything below ROCm6.x really sucks.

I tried to run qwen2.5-32B on ROCm5.x and it was running at <15tok/s lol.

Have you tried running any sort of LLM inference on your MI25, or what NN workloads are you running?