Hacker News new | ask | show | jobs
by wzdd 12 days ago
The article discusses a technique by which the author achieves high accuracy at detecting AI written text. Unless you have a problem with their experimental method, this is the opposite of tarot card reading.

> we are well into undetectable sophistication with today's models

The article directly contradicts this, as do you, in your previous paragraph: "Sure you might be able to detect today's tells". The article is literally about a technique that detects today's tells.

Your comment is mostly expressing doubt that this technique will work reliably in the future, but it's framed as opposition to the article, which it's not: the article is about detecting today's AI-written text, at which it seems to be quite successful.

1 comments

It does achieve high accuracy but I think given the context when one wants to know this information, plagarism for research papers and college/highschool essays and work, it's unfortunately not good enough.

My neighbour is a teacher. She has a really good idea which of her students uses AI to do their homework but 80% accuracy is not good enough. She'd need to be able to prove it with certainty.

The context in which the author wants to know this information is that they enjoy reading fiction, but not low-effort AI fiction, so they built a tool to filter out some of the low-effort AI fiction. Not every application is such a high-stakes affair that anything less than perfect isn't good enough.
not really, a strong suspicion is enough to motivate assigning an extra paper and pen in person test to a student, and then you can fail them on that result.
That seems pretty unfair. Why not make the original test pen and paper then? (Or at least a typewriter, offline computer, etc - my handwriting is awful)
Originally the idea was that a take-home essay would allow students to work at their own pace, study their own way, and produce something interesting. But if more than half will just prompt an AI and learn nothing, then I agree you should proctor all assessments.