Hacker News new | ask | show | jobs
by stfurkan 59 days ago
Currently I get around 2 tok/s on the 4B model, and 4-5 tok/s on the 1.7B model.