Hacker News new | ask | show | jobs
by Chrisszz 59 days ago
How fast it is to do stuff in the physical world ?
1 comments

Currently I get around 2 tok/s on the 4B model, and 4-5 tok/s on the 1.7B model.