[enriquepablo]

The Chomsky hierarchy is a classification of grammars. So it's about Syntax.

GPT is purely about semantics, about truth. To the extent that I think it can be said to be fundamentally informal in its dedication to truth, since it can easily be prompted to produce syntactically incorrect output - wrt the syntax of whatever language whose semantics determine the truth GPT is asked to reflect.

So I think this is a categorically incorrect question.

I mean, what is the fundamental syntax of the output of an LLM? It would have to be that any sequence of utf8 chars is valid.

[suddenlybananas]

LLMs have absolutely nothing to do with truth. If anything the analogy is closer to syntax as LLMs are pure form, just language in absence of any context or reference.

[enriquepablo]

LLMs tell you one thing and not its negation, this choice is semantic. "just language in absence of any context or reference" is a set that includes every valid text. The usefulness of LLMs is their ability to mostly respect whatever semantics you establish in the prompt in their choice of output.

[suddenlybananas]

LLMs will definitely tell you a thing and its negation if you prompt them differently.

[ursAxZA]

Isn’t it just symbols in, symbols out? We have hardware that can process long symbol sequences very fast — that’s basically it.