[gamegoblin]

Its context window is quite large -- 8192 tokens, where a token is about ~4 characters. But it's quite possible they are using GPT itself to summarize the older parts of the conversation so they can fit more in by only keeping the important bits.

[jb_s]

I was thinking something like that, bearing in mind that humans can't remember every single detail about a conversation either.