[fennecbutt]

Plus I'd say that the smaller context or more specific context is the important thing there.

Even the biggest models seem to have attention problems if you've got a huge context. Even though they support these long contexts it's kinda like a puppy distracted by a dozen toys around the room rather than a human going through a checklist of things.

So I try to give the puppy just one toy at a time.

[singularity2001]

OK so instead of my current approach of doing a single task at a time (and forgetting to clear the context;) this will make it more feasible to run longer and more complex tasks I think I get it.