Hacker News new | ask | show | jobs
by andrei_says_ 759 days ago
A word generator based on statistical probabilities. Has no understanding of the real world or logic. Everything is hallucinated, some word combinations coincide with reality but that’s a random occurrence.
1 comments

> Everything is hallucinated, some word combinations coincide with reality but that’s a random occurrence.

This isn't accurate, these models are trained and tuned to be correct, it's not a random occurrence.

How is correctness guaranteed? The model has no understanding, just a statistical analysis.

Or are we speaking of higher probability for correctness?

I was on that side of the argument as well, but it seems that models can have emerging model states of a given situation

https://arxiv.org/abs/2210.13382