Well, often when I ask ChatGPT how to code something, it uses some external package that turns out doesn't exist. I don't know what else you would call that. Hallucination seems appropriate enough to me.
Okay, but if you ask me the same thing and I use a library or tell you the name of a library that does not exist (although the name comes close), would you say I am hallucinating? If not, then how could we apply this to AI if we cannot even apply the term used for humans to me?