[smcn]

Given the amount of people blindly trusting the output, I think that a case could be made that guardrails are a necessity for LLMs.

The example in the article is medical diagnostics. Could you imagine if it started hallucinating and someone went with whatever insane advice it gave? Remember Google AI suggesting glue to keep cheese on pizza?

[euroderf]

1994: "It's on the Internet, so it must be true."

2024: "It's from an artificial intelligence, so it must be true."

[smcn]

That'd be a convincing argument if the internet wasn't brainwashing a significant portion of adults into believing weird things about the political elite, vaccines, 5G, etc.