Y
Hacker News
new
|
ask
|
show
|
jobs
by
newhouseb
1125 days ago
We're talking about the streaming API which streams generated text token by token, not the normal one-shot API. I have no insider knowledge but would agree with your intuition on the normal API.