Y
Hacker News
new
|
ask
|
show
|
jobs
by
throwawayffffas
17 days ago
The 5.2 tokens per second generation is not that bad, what kills it is the 16.2 prompt processing that makes this too slow to consider even if you have the hardware lying around.