[gdulli]

So much of the current internet is posts that read as a superposition of sincere and parody, and until that's resolved how do you know how to respond?

[samuelknight]

If that was a jab it my writing then yes, I am absolutely being sincere because I am an expert on this topic. LLMs went from being ok at one-shoting a function a to being so good at hacking that it's difficult to evaluate them. Prospective customers get back to us after a demo and tell us about the exploits it found on their services that are so vague and technical that they wouldn't think to look for them.

[streetfighter64]

> Prospective customers get back to us after a demo and tell us about the exploits it found on their services that are so vague and technical that they wouldn't think to look for them.

Um, have you actually verified that those are actual exploits then? Vague and technical sounds exactly like a description of AI slop...

[samuelknight]

Yes, that's how they become customers.

[saltcured]

Just wait until you see the same showing up in compliance realms...

Edit: to be slightly less implicit, consider the cargo cult madness that erupts from people thinking they can address risk management and compliance by auto-generating documentation and avoid really doing the legwork.