[alpaca128]

Why do you expect hallucination frequency to be the same when the LLM doesn't even remotely compare to a human brain yet? And what do they have to "look like"? This always reminds me of that time Bing's chat AI doubled down on a wrong fact about the Avatar 2 movie, which people used as evidence that the technology is dumb when it really is exactly the behaviour you can observe in many people every day. And there's a reason adults do it less frequently than children.

Compare the hallucination behaviour of a 7B model with a 70B model and then GPT4 and you'll quickly see the frequency of hallucinations right now doesn't mean much.