[cyanydeez]

not just that, but the entire industry spend several years seeking investment on the "pure" idea that they just need more compute and more parameters to reach AGI.

And the "business" obvious is still doing that but the science and implementation has be realizing that this just isn't true. They're not getting AGI out of a single LLM by itself.

[benterix]

They clearly know it but have to pretend otherwise to keep the money flowing.

[cyanydeez]

right, but the business arm will always be dominant. I see what Chinese models are doing as the same as japanese car models in the 80s: producing smaller, more efficient products that address the realities of the "total addressable market" that no business model would support. They're, unfortunately, providing public value where the US and Europe used to tread.

There's a lot to make efficient, but it should be clear to everyone that just throwing compute at larger models isn't going to magically make it rain.