|
|
|
|
|
|
by K0balt
462 days ago
|
|
|
The bias to assume that computers are going to produce correct answers is extremely strong. People intuit that Wikipedia is written by people, so they can apply that knowledge appropriately. For some reason, most people have a knee jerk reaction to a fully synthetic statement that biases them strongly towards the assumption of veracity. I always think of LLMs as “my functioning alcoholic veteran friend bob, who has several PHDs and was blown up a couple of times in Iraq”. That seems to be a good framework in order to intuit the usefulness of llm generated output. |
|
|
This. We know that computers are very good at actual computation, and we don't expect them to go completely haywire in conversations either.
Though this is beginning to change, with the observation of just how blatant some of the hallucations are, accusing random people of serious crimes etc. But the pro-computer bias is still strong.
There was an awful case of a system in the UK which accused postal officers of defraudation. The software malfunctioned, but people were indicted and punished by the courts relying on infallibility of computers, and some of the innocent victims committed suicide out of shame.