|
|
|
|
|
|
by _fat_santa
1 hour ago
|
|
|
At my org we've been building AI agents and one internal rule we have is to use at most 50% of the models context window with the recommendation to not go over 25% for large context window models. Anytime I see a "1M Context Window", my brain always goes "Gotcha so a 250k usable window" |
|
|