Hacker News new | ask | show | jobs
by jtorsella 2 days ago
Your citation was incorrect. The data also shows that pangram reliably tells the difference between those two cases. The statistic you made up or hallucinated is not supported by your link, and you’re being disingenuous here.
1 comments

The result I'm citing is very clearly presented in both a table and in supporting copy. It's even highlighted in the summary. Search for "65".
Thank you for pointing that out. But it still doesn’t support what you said, which is that only 65% of pangram’s fully AI claims are accurate. The “65% strict accuracy” rating is followed in the same sentence by a “97.5% inclusive accuracy” rating for the same reasons I pointed out above: pangram is systematically underrating the percentage AI in content, and it is tuned against producing false positives. The 32.5% in between the inclusive and strict accuracy ratings is entirely due to it estimating that 12 fully ai generated works were 60-80% AI, not the reverse. You can see that in table 4.