Hacker News new | ask | show | jobs
by nijave 4 hours ago
There's an env var you can set to tell it when to compact. It's especially helpful for models with big context that lose coherence much earlier.