|
|
|
|
|
|
by ifwinterco
19 days ago
|
|
|
It’s got worse though right? Older models from before everyone went off the deep end with CoT don’t do this and just write the code with 1/10 the token usage. The downside is the code isn’t as good but it is produced a lot faster and more cheaply and often it’s actually fine. CoT has made LLMs better (say 50% improvement or something) but increases cost by an order of magnitude. That graph is going in the wrong direction and has been for a while now |
|
|