|
|
|
|
|
by leo_e
198 days ago
|
|
Hard agree. The hidden cost of 'cheap' models is the complexity of the retry logic you have to write around them. If a cheaper model hallucinates halfway through a multi-step agent workflow, I burn more tokens on verification and error correction loops than if I just used the smart model upfront. 'Cost per successful task' is the only metric that matters in production. |
|