[crooked-v]

It sounds to me like the same thing behind the Vending-Bench (https://andonlabs.com/evals/vending-bench) insanity spirals: LLMs treats their assumptions as more important than whatever data they've been given.

[throwaway314155]

That doesn't really translate to language. Try using ChatGPT with and without search enabled and you'll see what I mean.