[zozbot234]

Does this also apply to LLM training at scale? I would be a bit surprised if it does, fwiw.

[_0ffh]

Yup, as soon as data is the bottleneck and not compute, diffusion wins. Tested following the Chinchilla scaling strategy from 7M to 2.5B parameters.

https://arxiv.org/abs/2507.15857