|
|
|
|
|
by CuriouslyC
136 days ago
|
|
A big part of the problem is that prompt injections are "meta" to the models, so model based detection is potentially getting scrambled by the injection as well. You need an analytic pass to flag/redact potential injections, a well aligned model should be robust at that point. |
|
there's probably some fun to be had with prompt injection for multi-agent systems: secretly spreading the word and enlisting each other in the mission; or constructing malicious behavior from the combined effect of inconspicuous, individually innocent-looking sub-behaviors