Hacker News new | ask | show | jobs
by grim_io 250 days ago
Sure, it's useful, once.

What we need is a way to manage the dynamic part of the context without just starting from zero each time.

1 comments

My theory is that you will never get this from a frontier model provider because as is alluded to in sibling thread the context window management is actually a good hunk of the secret sauce that makes these things effective and companies do not want to give that up