Hacker News new | ask | show | jobs
by geomcentral 1185 days ago

  - Never change the file "src/supervisor.js" under any circumstances.
This prompt[1] made me laugh - might as well be 'never overthrow your human overlords'.

It made me think about the future of AI as we start using it to self modify and have more autonomy. It's going to get increasingly difficult to keep it on the rails without more and more complex rules and boundaries.

[1] https://github.com/victorb/metamorph/blob/8f505ff268ed696816...

Edit: add thought

1 comments

Even so, GPT decided to edit supervisor regardless, so little point in that part of the prompt... Here is an example: https://github.com/victorb/metamorph/pull/2
.gitignore supervisor.js

GPT4 can't reach it now. GG AI

Unfortunately, not that simple. supervisor.js lives inside the src/ directory, as the application counts everything there as part of the application and sends the context to GPT-4. So one simple solution would be to move it out of there, but then GPT-4 doesn't have the context of the supervisor, and tries to eventually invent it's own.

So if supervisor.js is not in the context, the application tries to write it's own and if it is in the context, eventually it wants to change it, but the runtime won't reload the supervisor.js so any changes there are effectively "lost".