Y
Hacker News
new
|
ask
|
show
|
jobs
by
taktoa
1246 days ago
I'm pretty sure those numbers are for training, not inference. I've run it on _CPU_ and gotten ~1 token per second.