Hacker News new | ask | show | jobs
by gymbeaux 664 days ago
It depends on the model you run but generally speaking you want an NVIDIA GPU of some substance. I’d say like a 3060 at minimum.

CPU inference is incredibly slow versus my RTX 3090, but technically it will work.