Hacker News new | ask | show | jobs
by jboss10 29 days ago
For the 35B model, ofloading to RAM doesn't slow it down much. If you have a nice CPU and a weak GPU, it will be fast enough to use.