[NateEag]

> If this ruling forces companies to put more money into #3, whereas now they're coasting on good enough, I'd say it was speeding up innovation.

The thing is, no one has the slightest idea how to stop hallucinations.

The models are fundamentally "hallucinatory" at core - they generate what is _probable to follow the string thus far in its training corpus_, modulo RLHF and friends.

Notice that nothing there has any rigorous relationship to truth.

Sure, the companies could start pumping money into pure research on what models other than transformers might yield something that can reason rigorously, but at that point you're talking about finding a way to throw out LLMs entirely in favor of a less-pathologically-broken model, like Gary Marcus keeps complaining people should be doing.

[saalweachter]

Eh, I think LLMs will stay a part of what comes next, it will just be used for language I/O instead of everything.