|
|
|
|
|
by CjHuber
111 days ago
|
|
I mean I agree the last couple of messages in a rolling window are good to include, but that is not really most of what happens in compaction, right? > there's often tiny tidbits in your prompts that don't get written to plans. Then the prompt of what should be written down is not good enough, I don't see any way how those tidbits would survive any compaction attempts if the llm won't even write them down when prompted. >Secondly, it can keep eg long running background bash commands "going" and know what they are. This is very useful when diagnosing problems with a lot of tedious log prepping/debugging (no real reason these couldn't be moved to a new session tho). I cannot really say anything about that, because I never had the issue of having to debug background commands that exhaust the context window when started in a fresh one. I agree they are better now, probably because they have been trained on continuing after compaction, but still I wonder if I'm the only one who does not like compaction at all. Its just so much easier for an LLM to hallucinate stuff when it does have some lossy information instead of no information at all |
|
Anyway, that's just my experience.