[anon-3988]

To me, this exploits by LLMs just show much of our existing security comes from obscurity. We are (were) mostly secure because people can't be arsed to figure out how to do it. But now we have LLMs.

For instance, I am pretty sure that an LLM can figure out where someone roughly live based on a few images of you and your surrounding. Any hint of construction and the date and the LLM will scour all the public records for any such information.

Similarly, we need a truly sandboxed container without any escape hatches. AFAIK docker is not it. Maybe jails? I am not sure but this ought to be solved quick.

[pixl97]

This does nothing with a significantly advanced model. A model with no bad behaviors looks exactly like a model with hidden bad behaviors when it's in a training environment. After that point no one is going to run it in a jail because that is not useful.