Hacker News new | ask | show | jobs
by jstarfish 1132 days ago
At least there is usually a comments section on websites where people can call out bullshit.

If you're not an expert in your field, GPT will successfully lie to you. There's no second opinion.

Rather than a feelings filter, it needs an integrity filter.
1 comments
hammyhavoc 1132 days ago
There is a trend now of not having a comment section because it reduces server overhead by being able to serve a completely static page, and also directs the outrage and moderation required for it to social media, thus driving further traffic and reducing work required to deal with the fallout of it.

LLMs don't lie, that implies they have intent and is giving too much credibility to the idea that AGI may happen. They get things wrong because it's trying to use the wrong tool for the task at hand. It's a next word prediction engine, and that's not very useful for most things. By their very nature, they "hallucinate", but they don't really hallucinate, they just give the wrong output because it is just an LLM.

link
jstarfish 1132 days ago
Fraud requires intent. Lying is behavioral.

Pathological liars don't intend to deceive. They can't seem to stop themselves. They literally hallucinate events even when presented with evidence to the contrary and we still call them liars.

A "hallucination engine" presented as a source of truth is fundamentally dishonest. We don't go to fortune-tellers when we need legal advice. We don't learn law from reading every Matlock script ever written.

A human hallucinating behind the wheel and plowing into traffic gets jail and a license suspension. An AI doing the same gets a press release about FSD being right around the corner.

This tech is literally replacing humans (by abstraction of the responsibilities they assume). It needs to be held accountable as one even if it's not technically AGI (or wherever the goalposts are being moved to next).

But our continued faith in tech as a growth industry depends on it not being perceived as a lie, so we must keep up the illusion that your car is just suffering from cyberpsychosis when it hallucinates and drives you off a cliff.

link