Hacker News new | ask | show | jobs
by hammyhavoc 1148 days ago
And how about the negative responses involving hallucination? Ideally giving an example of the worst hallucination encountered thus far and least worst thus far.

As a potential customer, I'm more interested in knowing where the potential known failure points or points of friction are than knowing what's working well.

Yes, when it works, it's certainly compelling in its responses—but as it never knows when it is wrong, it is equally compelling at a cursory glance when it hallucinates.

For most folks interested in this, their Dunning-Kruger complex will prevent them from picking up on when it's wrong because it's so convincing and sure of itself.

1 comments

AI is useful for making suggestions, but you shouldn't blindly trust it like that no matter how advanced it gets. It helps you work faster, not beyond your abilities.
That's the thing, I'm not actually sure it does help someone work faster if everything it suggests needs to be fact-checked whilst under the guise of being always confident and never knowing it is wrong.

A lot of people liken AI to having a junior role working with you, but most junior positions have been to university and have a pretty solid understanding of a field in the first place. I wouldn't have a junior role hallucinating things that don't exist on a regular basis.

The speed of generating an output is only as meaningful as how consistently correct and appropriate that output is in terms of its value. I remain unconvinced.

If you don't do your job because you blindly accepted advice from a confident AI, a confident senior engineer, or a confident application note, then you might not have that job for much longer.

I don't know if it will make you personally work faster or not, that's your business to sort out.