[bongodongobob]

No, he's talking about memory getting passed into the prompts and maintaining control. When you turn on memory, you have no idea what's getting stuffed into the system prompt. This applies to chats and agents. He's talking about chat.

[labrador]

Parent is not chatting though. Parent is crafting a precise prompt. I agree, in that case you don't want memory to introduce global state.

I see the distinction between two workflows: one where you need deterministic control and one where you want emergent, exploratory conversation.

[bongodongobob]

Yes, you still craft an initial prompt with exploratory chats. I feel like I'm talking to a bot right now tbh.

[labrador]

The first sentence is mine. The second I adapted from Claude after it helped me understand why someone called my original reply insane. Turns out we're talking about different approaches to using LLMs.