Hacker News new | ask | show | jobs
by enragedcacti 1107 days ago
By definition most continuations won't be wildly divergent under a stochastic model because its following a bell curve.
1 comments

Stochasticty of meaning is not defined. I think it's an unfortunate use of the term

Humans are also like that

Difficulty to define rigorously does not preclude its existence or usefulness as model. The paper addresses how it feels humans are different from LLMs in reference to meaning.
Still sounds like a nonsense term. What would be non-stochasticity of meaning?
Reliably conferring the same mental model to another entity regardless of syntactic differences, or just failing to do so in a way that isn't predictable by a bell curve. The paper makes the argument that humans modelling the mental state of their conversation partner is part of how reliable meaning is exchanged, something that LLMs are unable to do because it is completely absent from their training data.