[bluGill]

I think it is more like the clerk would say "There never was a US vs Wilson" (well there probably was given how common that name is, but work with me). The AI doesn't have a concept of maybe I misunderstood the question. AI would likely give you a good summary if the case happened, but if it didn't it makes up a case.

[namaria]

Yes. That is precisely the problem with using LLMs. They wantonly make up text that has no basis in reality. That is the one and only problem I have with them.

[Bluecobra]

It would be kind of funny if we build a space probe with an LLM and shoot it out into space. Many years later intelligent life from far away discovers it and it somehow leads to our demise do to badly hallucinated answers.

[bluGill]

Space is so big and space travel is so slow that our sun will be dead before the probe is found by anyone else out there.

And that is assuming there even is someone out there, which isn't a given.