Hacker News new | ask | show | jobs
by observationist 698 days ago
Predictability with a particular set of prompts and processes. Over time, you'd migrate to the lower cost, higher performing model, as long as it can be at least as consistent as the higher cost model. People have built really weirdly intricate chains of dependency on things that particular models are good at, and sometimes 3.5 turbo can accomplish a task dependably where other models might refuse, or have too wide a variance to be relied on.

Over time, reliability and predictability will be much less an issue.