Hacker News new | ask | show | jobs
by navanchauhan 260 days ago
You have to specify `/model sonnet[1m]` to get the 1 million context version
2 comments

Be careful. exceeding around the original 200k tokens leads to worse and worse results. It's important to have context clean and tailored to the current task.
Yes, but at the same time having the 1 million context enabled is nice because the model is aware that they have more context left and actually perform better. [0]

[0] https://cognition.ai/blog/devin-sonnet-4-5-lessons-and-chall...

Thank you!! I've been looking for this for a while now.