[josu]

The combination of the most probable tokens doesn't necessarily have to be in the training set, thus creating something completely novel.

[e12e]

If you shuffle a deck of cards, you likely have a novel sequence of cards. I'm not sure how that is relevant?

[josu]

I was responding to this "merely produces syntactically likely combinations of the training data".

[DiabloD3]

That is called a hallucination.

[josu]

Yes, like the Jacobian counterexample.

[inigyou]

That LLM was attached to a Python and MATLAB evaluator. It generated plausible things to feed into a real computer.

[pixl97]

Weird take as a lot of things humans invent and test are done in similar ways.

[Gander5739]

Only if it's incorrect.