[hn_acc1]

And then you let them train themselves and no one notices when they "accidentally" remove the guardrail prompts from the next version. And another 10 years later, almost no one remembers how "The Guardian" learns new things or how to stop it from being evil.

[jama211]

That’s a little out of scope of my comment but yes, that’s another worry.