Hacker News new | ask | show | jobs
by qa34514324 236 days ago
I have tested the AI SAST tools that were hyped after a curl article on several C code bases and they found nothing.

Which low level code base have you tried this latest tool on? Official Anthropic commercials do not count.

1 comments

You're posting this comment on a thread attached to an article where Filippo Valsorda - a noted cryptography expert - used these tools to track down gnarly bugs in Go cryptography code.
They're also using "AI SAST tools", which: I would not expect anything branded as a "SAST" tool to find interesting bugs. SAST is a term of art for "pattern matching to a grocery list of specific bugs".
ZeroPath for example brands itself as "AI" SAST. I agree that these tools do not find anything interesting.
These are not "gnarly bugs".
They're not?
100% reproducible deterministic bugs are absolutely the easiest class of bugs.