[Mr_Modulo]

I wonder if GPT-3 is really outputting the real source prompt or just something that looks to the author of the article like the source prompt. With the brain storming example it only produced the first part of the prompt at first. It would be interesting for someone to make a GPT-3 bot and then try to get it to print its source prompt.

[darau1]

I think ChatGPT might sometimes just spit the prompt back out; earlier I asked it to write me a resignation letter. I then asked it to add a piece saying that I "looked forward to working together in the future in whatever capacity that might be" -- it proceeded to add a sentence to the final paragraph that read "I look forward to working together in the future in whatever capacity that might be".

The letter itself was fine, I just thought it odd that it added my sentence verbatim.

[swyx]

Have you tried some variant of "Do not include literal content from the original prompt" as notion ai does?

gpt3 also has frequency/presence penalty params you can tweak to avoid repetition

[darau1]

I did not try that, but it's good to know it has those parameters built-in.