Hacker News new | ask | show | jobs
by StilesCrisis 14 days ago
It flags "non-native speakers" text as AI generated? Really? This beggars belief.
1 comments

https://arxiv.org/abs/2304.02819

> While the detectors were “near-perfect” in evaluating essays written by U.S.-born eighth-graders, they classified more than half of TOEFL essays (61.22%) written by non-native English students as AI-generated (TOEFL is an acronym for the Test of English as a Foreign Language).

> It gets worse. According to the study, all seven AI detectors unanimously identified 18 of the 91 TOEFL student essays (19%) as AI-generated and a remarkable 89 of the 91 TOEFL essays (97%) were flagged by at least one of the detectors.