[Tomte]

This made me think there is more to it than stochastic completion:

Bowman, Samuel R. “Eight Things to Know about Large Language Models,” April 2, 2023. https://doi.org/10.48550/arXiv.2304.00612.

[kromem]

It's a good summary and all the papers cited in its point 3 are worth an additional read.