[genocidicbunny]

That is going to heavily depend on the judge and potentially jury. There are plenty of them, that will for whatever reason -- ignorance, intentional or not -- will accept the hallucinations as real enough to taint their decisions.

Even if ultimately proven false, you're going to need to expend additional resources to prove that. Especially if the 'hallucinations' are just barely untrue.

HN has an extremely skewed perception of how easily the average person, of which those in the legal profession, and even most HN posters myself included are, is deceived by false information that somewhat matches their worldview. And it will only become worse as AI becomes more authoritative on other topics -- why not trust the AI on this topic if you already trust it in so many others.