Hacker News new | ask | show | jobs
by treesprite82 1428 days ago
> But ask which is heavier, a goldfish or a whale, and it will tell you a goldfish. Or ask what Napoleon said about hamburgers, and it will say, “Hamburgers are the food of the gods.”

Both are answered correctly by GPT-3 on OpenAI Playground's default Q&A preset: https://i.imgur.com/ewpvhp9.png

Likely comes down to the instructions/examples given. The Q&A preset tells it to give factual answers and respond to trickery with "Unknown", whereas by default - since its training includes fiction material - it's not really wrong to make up some plausible answer to fictional questions like "Where does the wizard Uldywuld live?".

i.e. it has the ability to disregard nonsense and give factual answers (well, to a certain extent: https://i.imgur.com/sKO5inu.png) , but you have to specify that's what you want since by default it's more general than factual Q&A.