|
|
|
|
|
by giancarlostoro
1 day ago
|
|
1m is too high, they used to autocompact a little too soon, maybe I tweaked defaults, it was kind of annoying, 200k tokens is too soon for me, I feel like the sweet spot is around 400k tokens. Funnily enough Groks API charges less when you are below 400k tokens. Half a million can get you reasonably far with enough of your codebase within the models context window. I lowkey blame the 1m context window as the start of Anthropics worse woes earlier this year. |
|
CLAUDE_AUTOCOMPACT_PCT_OVERRIDE
And
CLAUDE_CODE_AUTO_COMPACT_WINDOW