[hoppp]

That's not always the case imho. Think about advances in running inference, any innovation will happen in the details. Higher layer can stack gpu's but the implementation can still be improved.

Often small technical changes like "making a service 5% faster" are worth millions for large companies. That's all implementation.

[danielbln]

I don't see why a strong model wouldn't significantly outperform any human in this sort of low level optimization work. We don't hand optimize assembly either.

[hoppp]

It's about the competitive edge. If a public model can do it, everyone has access to it so nobody has advantage.

If you want LLMs to be your advantage you can train your own, that's completely valid.

Let's say you want to have a company that runs inference 5% faster, if everyone can do it your business model is worthless.