Yeah. Ironically, if he used an LLM to proofread his work, it would have told him that GAN's are generative not "generalized". That LLMs are primarily built on Transformers rather than GANs. And that they're more famous for image generation rather than image recognition.
No, I simply think the person is not familiar with these concepts, which is not a crime, it's okay to be wrong, I didn't want to banish that person from here, just corrected the statement. But might have been also a brain fart. Happens. Just wanted to correct it in the interest of beginner reading this.
Once Musk said he believes in Transformers instead of diffusion (or the other way around). When actually diffusion transformers are very popular and mainstream. What he meant was autoregressive inference vs diffusion. People like to use buzzwords while not knowing them. Old issue, it was the same decades ago.
To make it even more confusing, there are also diffusion LLMs, which typically but not necessary, use transformers also.
And independently of diffusion and transformer and llm or image generator, you can optionally put a GAN discriminator adversarial loss on any of them.
In general probably not much of a stretch to get rid of convolutions or recurrence by replacing with attention and see if it works hence the title of the original transformers paper.
sorry but I see incorrect AI responses almost every day in things I query on Google, generally because I am often querying on something I am an expert in and I just want a linking source. There will be a good link in the result, generally, but the AI almost always messes up some elemental fact, sometimes it is because the AI has "misunderstood" what I asked which is reasonable, but most of the time the result shows that it has "understood" what I said but there will be a statement of fact that is just wrong.