[LeoPanthera]

Fairly clickbaity headline. Asking it to do so causes the response to terminate early with a message that says it may violate the TOS.

I don't think the actual TOS has been changed though.

[jncfhnb]

Disagree. It’s not the model outputting this message. It is a hard coded checked by open ai. It seems to very clearly be openai responding to the specific attack used by deepmind as explained by the article.

It is a TOS violation. It’s not a big one. But the weakness of the model is the story here.

[causi]

At this point there are so many checks and rules applied to ChatGPT one wonders just how much performance is being sacrificed. Is it totally miniscule? Could it be significant?

[underseacables]

Is it really artificial intelligence when there are so many human limits and rules placed on it?

[xigoi]

Artificial intelligence combined with natural stupidity.

[jncfhnb]

I don’t think that’s true is it? Most of these things are handled in the model prompt and tuning and have no impact on efficiency