[Prosammer]

I've been finding with these large context windows that context window length is no longer the bottleneck for me — the LLM will start to hallucinate / fail to find the stuff I want from the text long before I hit the context window limit.

[drcode]

Yeah, there is basically a soft limit now where it just is less effective as the context gets larger