Hacker News new | ask | show | jobs
by kristianp 1205 days ago
From the readme: On a Ryzen 7900X, the 7B model is able to infer several words per second, quite a lot better than you'd expect!