Hacker News new | ask | show | jobs
by jncfhnb 927 days ago
Disagree. It’s not the model outputting this message. It is a hard coded checked by open ai. It seems to very clearly be openai responding to the specific attack used by deepmind as explained by the article.

It is a TOS violation. It’s not a big one. But the weakness of the model is the story here.

1 comments

At this point there are so many checks and rules applied to ChatGPT one wonders just how much performance is being sacrificed. Is it totally miniscule? Could it be significant?
Is it really artificial intelligence when there are so many human limits and rules placed on it?
Artificial intelligence combined with natural stupidity.
I don’t think that’s true is it? Most of these things are handled in the model prompt and tuning and have no impact on efficiency