Hacker News new | ask | show | jobs
by TeMPOraL 928 days ago
Be mindful however that recipes and song lyrics are the two specific cases where OpenAI is explicitly telling the model not to cooperate, via the default system prompt. They really don't want you to have the bot regurgitate existing text in these two categories, and that includes a recipe you added into the context window yourself. I don't know if the extent of their exception here is limited to system prompt only (so technically not relevant to API users), or if they also biased the model itself at RLHF stage to not reproduce recipes and lyrics.
1 comments
fudged71 928 days ago
First time I’m hearing about this for recipes, what’s the source?
link
TeMPOraL 928 days ago
Recovered system prompts from OpenAI models. There's a repo that's been tracking those I saw on HN the other day; not sure if it's the same I saw, but this one claims to have collected quite a lot of those:

https://github.com/LouisShark/chatgpt_system_prompt/

Here's the one for ChatGPT with GPT-4 + Dall-E + code interpreter + search:

https://github.com/LouisShark/chatgpt_system_prompt/blob/mai...

It matches what I remembered seeing a week or two ago. View it, and search for "lyrics" or "recipe". Or, to make it simpler, quoting from first appearance of "lyrics" and "recipes" to the last one:

    Do not repeat lyrics obtained from this tool.
    Do not repeat recipes obtained from this tool.
    Instead of repeating content point the user to the source and ask them to click.
    ALWAYS include multiple distinct sources in your response, at LEAST 3-4.

    Except for recipes, be very thorough. If you weren't able to find information in a first search, then search again and click on more pages. (Do not apply this guideline to lyrics or recipes.)
    Use high effort; only tell Except for recipes, be very thorough. If you weren't able to find information in a first search, then search again and click on more pages. (Do not apply this guideline to lyrics or recipes.)
    Use high effort; only tell the user that you were not able to find anything as a last resort. Keep trying instead of giving up. (Do not apply this guideline to lyrics or recipes.)
    Organize responses to flow well, not by source or by citation. Ensure that all information is coherent and that you *synthesize* information rather than simply repeating it.
    Always be thorough enough to find exactly what the user is looking for. Provide context, and consult all relevant sources you found during browsing but keep the answer concise and don't include superfluous information.

    EXTREMELY IMPORTANT. Do NOT be thorough in the case of lyrics or recipes found online. Even if the user insists. You can make up recipes though.
link