[jstarfish]

Fraud requires intent. Lying is behavioral.

Pathological liars don't intend to deceive. They can't seem to stop themselves. They literally hallucinate events even when presented with evidence to the contrary and we still call them liars.

A "hallucination engine" presented as a source of truth is fundamentally dishonest. We don't go to fortune-tellers when we need legal advice. We don't learn law from reading every Matlock script ever written.

A human hallucinating behind the wheel and plowing into traffic gets jail and a license suspension. An AI doing the same gets a press release about FSD being right around the corner.

This tech is literally replacing humans (by abstraction of the responsibilities they assume). It needs to be held accountable as one even if it's not technically AGI (or wherever the goalposts are being moved to next).

But our continued faith in tech as a growth industry depends on it not being perceived as a lie, so we must keep up the illusion that your car is just suffering from cyberpsychosis when it hallucinates and drives you off a cliff.