Hacker News new | ask | show | jobs
by conception 245 days ago
This is an excellent example of human “context windows” though and it could be the llm could have solved the easy problem with better context engineering. Despite 1M token windows, things still start to get progressively worse after 100k. LLMs would overnight be amazingly better with a reliable 1M window.
1 comments

What does "better context engineering" mean here? How/why are the existing token windows "unreliable"?