|
|
|
|
|
by freejazz
1227 days ago
|
|
>To about the same degree as the output of a human. No. Full stop. Humans aren't stochastic parrots. Pointing to a lack of understanding about what exactly happens in the human mind is, FULL STOP, not evidence that LLMs are doing the same things humans do. |
|
Humans are not stochastic, they're obviously chaotic[1]. Which is to say: not parrots at all.
Some of the modern models I've seen also seem to be chaotic too though, so that's interesting [2]. I'm going to assume LLMs probably exhibit the same properties.
[1] https://en.wikipedia.org/wiki/Chaos_theory (Chaotic systems sometimes seem to be stochastic, but they're actually much stranger and more interesting!)
[2] I've been messing with stable diffusion to get a feel for (and/or avoid) tipping points: that is to say, points in latent space where the model becomes very sensitive to small changes in initial parameters. You can find instances fairly quickly even by hand by doing bisect search.