[sosodev]

I hope the industry starts competing more on highest scores with lowest tokens like this. It's a win for everybody. It means the model is more intelligent, is more efficient to inference, and costs less for the end user.

So much bench-maxxing is just giving the model a ton of tokens so it can inefficiently explore the solution space.

[an0malous]

The premise of the trillion dollars in AI investments is not that it’ll be as good as it currently is but cheaper. It’s AGI or bust at this point.

[stonecauldron]

Right, but my belief is that the LLM paradigm is a dead end for AGI. We need something different to cross that barrier.

[dcre]

Why is AGI required to make the investments work out?

[xutopia]

With AGI we expect a huge return on investment and a GDP growth that could be accelerating at a rate we couldn't even comprehend. Imagine an algorithm that improves itself each iteration and finds ways to increase its capacity every day. Robots suddenly capable of doing dishes, grocery shopping, picking produce from the field. Imagine all your ailments handled... age becomes just a number.

Also with AGI we expect a winner take all situation. The first AGI system would protect itself against any other AGI system. Hence why it's go time for all these AI companies and why they stopped sharing their research.

[dcre]

This does not answer my question.

[HDBaseT]

It does. If AGI is achieved, OpenAI or whatever frontier AI Lab will effectively become a mega company with the ability to do anything.

A chatbot is not the long term goal for any of these companies.

[dcre]

My question is why AGI is required for these companies to be viable, i.e., why these companies cannot be viable in the case where AGI is not achieved. A response about what happens when AGI is achieved does not address that.

[sosodev]

Yeah, but don’t you agree that less tokens to accomplish the same goal is a sign of increasing intelligence?

[camdenreslink]

It could be. Or just smarter caching (which wouldn't necessarily have to do with model intelligence). Or just overfitting on the 95% most common prompts (which could save tokens but make the models less intelligent/flexible).

[energy123]

Less cost to accomplish the same goal is a sign of intelligence. That's not necessarily achieved with less tokens but it may be.

[mchusma]

Kind of? But I really care about price speed and quality. If it used 10x tokens at 1/10th the tokens and same latency I would be neutral on it.

Kimmi 2.6 for example seems to throw more tokens to improve performance (for better or worse)