[mabbo]

Yeah, but you could ask the LLM to do a few different things at each step.

You could provide it with the background, the story, the secrets, and the summary of everything that has happened so far- as well as what new things have taken place. Then ask it to re-write the summary of the story so far.

Separately, you could give it all that context and what the players have asked of it, and as what response to give.

As well, you could be recording all the events that have happened in a vector store, and do a search on it when players ask questions, and use those as context to the LLM when asking it what to reply.

There's lots of neat tricks we can use to help an LLM overcome it's limitations.