[simonw]

That depends on what additional capabilities and tools you've made available to your LLM.

If you've granted it access to private data or given it the ability to write and execute code - both things people are starting to actually do - it could be very serious indeed: https://simonwillison.net/2023/Apr/14/worst-that-can-happen/