[amerkhalid]

> > I would never assume the AI answer to a consequential problem to be authoritative, unless it shows me the source and I can click on the link to verify the source and the data presented (search engine use case).

> That remains the elephant in the room - the tendency to make up fake answers. Until that's fixed, LLMs are only useful for problems where the cost of such errors is an externality, dumped on the consumer.

That’s one of fears. The general public and politicians alike will trust AI without scrutiny. We’ve already seen examples of judges relying on flawed software, with devastating outcomes for innocent people. With the rapid push and widespread enthusiasm for AI, a darker future looms if these problems aren’t addressed.