[simianwords]

The author understands well that Opensource is catching up but I think that the gap will remain constant - SOTA models will still be more performant.

The author mentions $54 in costs but the reality is that developers are paid around this much per hour.

What is likely to happen: LLM performance goes even higher and can do tasks that take humans days to accomplish. You then have to compare LLM cost with human cost - something the Author has forgotten in their analsys.

[xienze]

> The author mentions $54 in costs but the reality is that developers are paid around this much per hour.

Sure, but imagine a situation where you've spent an hour going back and forth with the LLM trying to fix a problem and at the end of it you've only made minimal progress. Now you've spent an hour of your time AND $54 with little to show for it. It's a metric I don't think many people track: the cost of going in circles with an LLM for an extended period of time while burning tokens and still not resolving the problem.

[simianwords]

That happens with humans too and for sure LLMs make it better not worse.

I know the number of times I tried to do something where the answer was simple but I took a few days to get there.