Hacker News new | ask | show | jobs
by technoabsurdist 29 days ago
yes it is 213 tok/s single stream (so per user)
2 comments

that 213 wasn't achieved when saturated though. was probably more like 30 tps per stream when doing 2.6k tps.
So per subagent*.
*per stream, I guess is more accurate than either?