[tempfile]

I think the evidence is actually pretty strongly against them doing anything similar to "thinking". Certainly they are exhibiting some behaviour that we have traditionally only associated with thinking. But this comes along with lots of behaviour that is fundamentally opposite to thinking ("hallucination" being the major example).

It seems much more likely that they are doing some other behaviour that only sometimes resembles thinking, in the same way that when you press the middle autocomplete button on your phone keyboard it only sometimes resembles conversation.

[groestl]

> "hallucination" ... "behaviour that only sometimes resembles thinking"

I guess you'll find that if you limit the definition of thinking that much most humans are not capable of thinking either.

[Yizahi]

You see, we are here observing a clash in the terminology. Hallucinations in humans is thinking, just not typical. So called "hallucinations" in LLM programs are just noise output, a garbage. This is why using anthropomorphic terms for programs is bad. Just like "thinking" or "reasoning".

[groestl]

I think the answer is somewhere in the middle, not as restrictive as parent, but also not as wide as AI companies want us to believe. My personal opinion is that hallucinations (random noise) are a fundamental building block of what makes human thinking and creativity possible, but we have additional modes of neuroprocessing layered on top of it, which filter and modify the underlying hallucinations in a way so they become directed at a purpose. We see the opposite if the filters fail, in some non-neurotypical individuals, due to a variety of causes. We also make use of tools to optimize that filter function further by externalizing it.

The flip side of this is that fundamentally, I don't see a reason why machines could not get the same filtering capabilities over time by adjusting their architecture.

[tempfile]

I have never in my life met a person who hallucinates in the way ChatGPT etc do. If I did, I would probably assume they were deliberately lying, or very unwell.

[vidarh]

> But this comes along with lots of behaviour that is fundamentally opposite to thinking ("hallucination" being the major example).

I find this an utterly bizarre claim given how prone humans are to make things up and firmly insist they did not.

[tempfile]

Is this really common behaviour? I do not recognise it. Do people lie? Certainly yes. Do people misremember, or get details incorrect? Yes. But when was the last time you saw someone, say, fabricate an entire citation in a paper? People make transcription errors, they misremember dates, and they deliberately lie. But I don't think people accidentally invent entire facts.

[vidarh]

To me, your entire claim here comes across as "hallucination". That is, I simply do not believe that you have not experienced people accidentally inventing entire facts, and so I don't believe you are genuinely unaware of people doing it.

To be clear, I'm not arguing you've made this claim in bad faith at all.

However, going back and examining my own writing, I have more than once found claims that I'm sure I believed at the time of making them, but that I in retrospect realise I had no actual backing for, and which were for that reason effectively pure fabrication.

An enduring memory of my school days was convincing the teacher that she was wrong about a basic fact of geography. I was convinced. I had also totally made up what I told her, and provided elaborate arguments in favour of my position.

To me this is innate human behaviour that I see on a regular basis. People accidentally invent entire "facts" all the time.

[fragmede]

What little of Fox News excerpted I've seen elsewhere doesn't support your claim.

[tempfile]

Fox News just lies. They aren't "hallucinating".

[vidarh]

What do you imagine the difference is?

[falcor84]

Indeed. The mere fact that we ended up with the anthropomorphic term "hallucination", rather than something purely mechanistic like "glitch", indicates that there's something about this AI pattern that feels familiar.

I'm obviously not claiming that "hallucination" is an appropriate term ("delusion" or "confabulation" are probably more apt), but there is something here that is clearly not just a bug, but rather a result of thinking being applied properly but to ungrounded premises. To my eyes, reading an AIs "hallucination" is not unlike reading the writings of a human on drugs, or with a mental condition like schizophrenia, or just of an analytic philosopher taking their made up axioms all the way to an alternate universe.

[throw310822]

> behaviour that is fundamentally opposite to thinking ("hallucination")

Did you just make this up?

[tempfile]

> Did you make this [opinion] up?

Yes! That is how they work.

[throw310822]

Can you please also hallucinate a plausible-sounding justification for this otherwise unsubstantiated statement?

Jokes aside, we do produce plausibile sounding stuff all the time well beyond the limit of what we actually know or can prove. I think there is a continuum between formulating statements about things we don't know for sure and we can't prove, guessing details here and there to fill gaps in our memory, misremembering things that we thought we knew, and making up entire facts that sound plausible but are completely invented. Yes, llms seem to have trouble introspecting what they actually know; but it sounds more like a missing skill rather than a fundamental difference in the way they reason.