Y
Hacker News
new
|
ask
|
show
|
jobs
by
gymbeaux
664 days ago
It depends on the model you run but generally speaking you want an NVIDIA GPU of some substance. I’d say like a 3060 at minimum.
CPU inference is incredibly slow versus my RTX 3090, but technically it will work.