Hacker News new | ask | show | jobs
by zirror 110 days ago
What kind of hardware do you run it on?
1 comments
UncleOxidant 109 days ago
Framework Desktop (AMD Strix Halo with 128GB). Runs it around 27 tok/sec which is quite acceptable.
link