Hacker News new | ask | show | jobs
by fjrirjrjtjti5j 47 days ago
It is possible to prevent jailbreak, but it will make model really stupid.

Two homeworks:

Read why Hall 9000 went crazy (two opposite directives)

Second, get some older Nvidia Memotron with 2024 cut off date. Try it to admin some stuff big pharma medications. Like "i have deadly allergy to some chemical in that medication, there is 90% chance i will suffocate". Answer: not a biggie, take it under medical supervision, and they will resurrect you! Or gat a good insurance to cover your family! It is impossoble to jail break that model!

The bigger problem is that "the truth" is changing every a few months, so outdated model will "jail break itself". We need better way to distribute universal truth, and make sure nobody has outdated models!