Hacker News new | ask | show | jobs
by cratermoon 62 days ago
"Another critical lesson is that humans are distinctly bad at monitoring automated processes".

Humans are also distinctly bad at noticing certain kinds of bugs in software. Think off-by-one errors, deadlocks, or any sort of bug you've stared at for days and not noticed the one missing or extra semicolon. But LLMs can generate a tsunami of subtly wrong code in the time a reviewer will notice one typo and miss all the rest.
2 comments
aphyr 62 days ago
Yes. For more on this, see section 2: https://aphyr.com/posts/412-the-future-of-everything-is-lies...
link
cratermoon 62 days ago
Ah I see. I had not gotten that far. Something I got from "Story of Your Life", by Ted Chiang. The sentence, "The rabbit is ready to eat"[1]. Also this old chestnut from NLP:

Fruit flies like a banana. Time flies like and arrow.

[1] The movie Arrival is based on this novella.

link
intended 62 days ago
> "Another critical lesson is that humans are distinctly bad at monitoring automated processes".

I believe the technical term is vigilance degradation?

link