Hacker News new | ask | show | jobs
by embedding-shape 183 days ago
When I receive something that either I suspect an LLM wrote 90% of, or the author is up front about it, I always ask "Did you check all of this yourself to verify before I pick it up?" and maybe half of the times I get a no, and then they return a day later with a new document and some fixes. Other half the time people say yes, I start digging into it, start finding bunch of weird stuff and send it back to the person.

I don't really care if it's a person or the LLM getting it wrong, if you're sending me stuff that you checked or haven't checked but it's wrong/ambiguous anyways, I'm sending it back to you to fix.

1 comments

> I don't really care if it's a person or the LLM getting it wrong,

You're nicer than some of us.

If it's an LLM getting it wrong, and it's not caught before it gets to you, then what value is the intermediary adding to the process?

I meant it in a way that I'll blame the person regardless of who actually wrote the text. The LLM messed up and you failed to notice? I blame you. You messed up and failed to notice? I still blame you.
I get that.

But, as discussed in some other threads, the leverage provided by the LLM allows the miscreant to inundate you with slop by only pressing a few buttons.

And rejection is work. So they can produce more slop, requiring more rejections, faster than you can read the slop.

This is what's new. You reject it, they feed your rejection back into the LLM, and hand you something 5 minutes later with so many formatting changes that diff is unhelpful, and enough subtle substantive changes embedded in it that if you don't read the entire thing, you might have missed something important.

Yeah, that's not how it works, in my experience. They hand me something, I notice it's likely written by LLM, ask them. They say "Yeah, some quick things blah blah" and then I ask "Did you check all the details themselves?" and they say "Yeah, most of them" and then I answer "Ok, check all the details, then I'll go through it" and then later they come back and things look a lot better.

If you're ending up doing this back and forth with someone more than once, just outright refuse to work with someone so unprofessional who doesn't even validate their own work. It wouldn't fly in most workplaces I've worked in.