[DeathArrow]

>Most generative AI models nowadays are autoregressive.

There are also diffusion based models which don't rely on next token prediction.

[Wonderfall]

Yeah, this is mentioned in the article. (The LLaDa paper is even what triggered its writing!)