Hacker News new | ask | show | jobs
by dack 90 days ago
i want 5.4 nano to decide whether my prompt needs 5.4 xhigh and route to it automatically
2 comments

As per OpenAI themselves, xhigh is only necessary if the agent gets stuck on a long running task. Otherwise it’s thinking trades use so many tokens of context that it’s less effective than high for a great majority of tasks. This has also been my experience.
yes but didn't greg brockman say he just runs on xhigh at all times?
Like any work estimation, it will likely disappoint.