Hacker News new | ask | show | jobs
by newhouseb 1125 days ago
We're talking about the streaming API which streams generated text token by token, not the normal one-shot API. I have no insider knowledge but would agree with your intuition on the normal API.