[ssivark]

If/when a breach does happen, are you going to shrug and say “Gee… who would’ve thunk?!”, or are you going to be accountable for the consequences? Is this the kind of defense an LLM service can bet their company on? How do you think a cybersecurity/insurance company will price the risk of a negative fat tailed outcome?

[mcaledonensis]

Breaches happen with humans too. Social engineering works. As long as the costs of a breach are not too high, this can simply be a cost of doing business.

[codeflo]

However, social engineering is orders of magnitude less automatable and scalable than prompt engineering is.