Hacker News new | ask | show | jobs
by nunez 344 days ago
I'm siding with OP.

Yes, LLMs hallucinating is a well-known bug (or feature, depending on who you ask).

We also know that people _will_ use LLM output before doing their own research _because that is how they are designed to be used._

OP should have manually confirmed the LLM outputs. But therein lies the rub. These services are designed to authoritatively provide answers to whatever you ask it, but there is *almost zero* point in using these tools if you have to manually verify everything it says because nothing it says can be trusted.

Given that OP is paying for Claude, there should be partial compensation for losses incurred due to hallucinations. Something's gotta give.