[wkat4242]

Ollama supports many radeons now. And I guess llama.cpp does too, after all it's what ollama uses as backend.

[p1esk]

PyTorch (the underlying framework of HF) supports AMD as well, though I haven’t tried it.