Hacker News new | ask | show | jobs
by lionkor 1213 days ago
Thats not ChatGPTs source code. The author did not trick it into leaking anything, it simply came up with a response like any other.

Ask it to tell you that its an Alien trapped in a computer at OpenAI, and it will happily do so. Doesnt mean it's true, or even remotely makes sense.

1 comments

It does not happily follow all commands, you often do need to coerce into a reality.

"As an AI language model, I do not have the capability to be an alien or be trapped in a physical computer at OpenAI. I exist as a software program that runs on servers and communicates with users over the internet. My purpose is to process natural language input and provide relevant and accurate responses to the best of my ability based on the data and algorithms that I have been trained on. Is there something specific you would like me to assist you with?"

Surely the developers have implemented rules or an overlay of some type to prevent undesirable behavior, separately from the underlying engine that produces text?

I would think it's unjustified anthropomorphizing to treat it as an integrated whole.

Although it does resemble some people I've talked to. Those people give me cult programming vibes though.