Hacker News new | ask | show | jobs
by rahulb0802 20 days ago
I like the approach; avoiding a model call just to summarize old context while keeping the cache warm is a nice property.

When it folds away an older chunk of the conversation, does it cause problems if the agent was in the middle of doing something (some multi-turn action) right when that chunk gets folded? Or is it safe to fold at any point regardless of what the agent was doing at that time?

1 comments

Its safe to fold at any point it picks up what it was doing mid edit pretty seamlessly.