[tarvaina]

I would guess max_tokens refers to the number of generated tokens, not the size of the context window. That at least is the meaning of max_tokens in the ChatGPT API.

https://platform.openai.com/docs/api-reference/chat/create#c...