[kozikow]

Any production deployment would probably do pre-fetching of potential initial dialogues as some kind of background job.

[squigz]

On this note - and as a response to the point a commenter made that too much freedom in dialogue might actually be a bad thing - LLMs could then be used to expand on the initial dialogue in a way that feels more 'organic' every time you hear it, but is still close to the artists' vision.