| This is still not true. "Whenever they get something "right," it's literally by accident." "the random word generator" First of, the input is not random at all which allows the question how random the output is. Second, it compresses data which has an impact on that data. Probably cleaning or adjustment which should reduce 'random' even more. It compresses data from us into concepts. A high level concept is more robust than 'random'. Thinking or reasoning models are also finetuning the response by walking the hyperspace and basically collecting and strengthening data. We as humans do very similiar things and no one is calling us just random word predictors... And because of this, "hallucinations -- plausible but factually incorrect outputs" is an absolut accurate description of what an LLM does when it response with a low probability output. Humans also do this often enough btw. Please stop saying an LLM is just a random word predictor. |