Hacker News new | ask | show | jobs
by boywitharupee 1124 days ago
Any new call to the API is considered fresh. I don't believe your session is saved.
1 comments

We're talking about the streaming API which streams generated text token by token, not the normal one-shot API. I have no insider knowledge but would agree with your intuition on the normal API.