[malfist]

It's a critical problem like when a drug dealers supply kills someone and they get a bump in business because they're selling "the real deal"

[Paracompact]

Irrelevant to your point, but drug users dying is more often the result of a dealer cutting their supply with something dangerous than it is the result of purity.

[malfist]

Right, and an LLM being able to "escape confinement" is more likely to be poor confinement or a PR stunt than a "too powerful" llm. Same situation

[pixl97]

No, not really as almost no one runs LLMs in confinement once they are released and the capability is a jailbreak away. Poor confinement is irrelevant, if I use your model to check the security of my code and it hacks into the company that makes libraries used inside of it it's a huge problem.

[gloryjulio]

Second this. Lots of fentanyl overdose are caused by accident, not because the buyers are buying them. It is extremely dangerous