[uberman]

I assume you mean outside the boundaries of context window size or token thresholds right?

[boh144]

Both in a way. I'd say it gets worse outside the context window it seems to get worse due to compression and loss of detail. Even in a single context window it's hard to keep ideas and branches clean and remember important insights.