Y
Hacker News
new
|
ask
|
show
|
jobs
by
technoabsurdist
29 days ago
yes it is 213 tok/s single stream (so per user)
2 comments
unrvl22
29 days ago
that 213 wasn't achieved when saturated though. was probably more like 30 tps per stream when doing 2.6k tps.
link
3836293648
29 days ago
So per subagent*.
link
alienbaby
29 days ago
*per stream, I guess is more accurate than either?
link