Y
Hacker News
new
|
ask
|
show
|
jobs
by
tarruda
19 days ago
Assuming steady 1 tok/second generation (which seems to be the case for M5 Max macbook), wait 1 day for a 86400 token response. In some configurations it can be as slow as 0.1 tok/s, so be prepared to wait for 10 days.