Hacker News new | ask | show | jobs
by khurdula 623 days ago
Are we supposed to use AMD GPUs for this to work? Or Does it work on any GPU?
1 comments

> This project provides a Docker-based inference engine for running Large Language Models (LLMs) on AMD GPUs.

First sentence of the README in the repo. Was it somehow unclear?