Hacker News new | ask | show | jobs
by justinclift 104 days ago
> What's the danger?

Hallucinated ideas about what needs doing, what commands to run, etc.

So, data that's no longer reliable (ie could be subtly changed), or even outright data loss.
1 comments
Natfan 104 days ago
just don't accept bogus changes it suggests? this is why having a human in the loop is a very good idea
link
justinclift 104 days ago
Yep, I fully agree. It'd be awesome if all (or even most?) of the users were immune to automation bias though. :)

https://en.wikipedia.org/wiki/Automation_bias

And hopefully the users who are using this aren't YOLO-ing it. Though I'm pretty sure we're all expecting there will be a sizeable percentage who are.

link