[adastra22]

It can even dynamically extend by using prompts to generate new rooms as the user enters them, but keeping track of generated world outside of the LLM.

Which is the same way nearly all procedurally generated games work.