Hacker News new | ask | show | jobs
by mooneater 1487 days ago
> not prediction based on anything statistical but based on one's understanding

It is still statistical. You still want to predict a distribution over expected next token.

However, the function needed to estimate the likely next tokens are not simple max over enumerated next tokens like in a language model. It's more like a transition model in reinforcement learning.

1 comments

> It is still statistical. You still want to predict a distribution over expected next token.

The fact that a process can be described statistically does not make the process itself statistical.

With the current craze of neural networks people would like to think that anything that happens in the Universe is statistical. But it's really not.
Quantum mechanics is probablistic. But the probabilities are deterministic.