[coherentpony]

It bothers me that the word 'hallucinate' is used to describe when the output of a machine learning model is wrong.

In other fields, when models are wrong, the discussion is around 'errors'. How large the errors are, their structural nature, possible bounds, and so forth. But when it's AI it's a 'hallucination'. Almost as if the thing is feeling a bit poorly and just needs to rest and take some fever-reducer before being correct again.

It bothers me. Probably more than it should, but it does.

[pertymcpert]

I think hallucinate is a good term because when an AI completely makes up facts or APIs etc it doesn't do so as a minor mistake of an otherwise correct reasoning step.

[throwawaymaths]

its more like conspiracy theory. when you're picking a token youre kinda like putting a gun to the LLM's head and demanding, "what you got next?"