> People believe for some reason that the AI is 99.99% correct and the warning not to trust it too much is just legalese.
That "some reason" is science fiction plus some modern-day hype. The sci-fi trope of AI is that it's something more intelligent and perfect than any human (e.g. Data from Star Trek or even HAL, despite his malfunctions), and the people who are selling LLMs are happy to let influence people to over-estimate LLM capabilities.
There's no sci-fi model for subhuman and kinda crappy generative AI.
That "some reason" is science fiction plus some modern-day hype. The sci-fi trope of AI is that it's something more intelligent and perfect than any human (e.g. Data from Star Trek or even HAL, despite his malfunctions), and the people who are selling LLMs are happy to let influence people to over-estimate LLM capabilities.
There's no sci-fi model for subhuman and kinda crappy generative AI.