Hacker News new | ask | show | jobs
by jerf 1376 days ago
"Write a palindrome... do things in pig latin, or write N-word sentences composed of monosyllables, or telling it to coin a word that would be used in "Jabberwocky,""

See: https://www.gwern.net/GPT-3#bpes . GPT-3 can't do these things as an artifact of its training bias (in the machine learning sense of the term bias). It can't learn about palindromes because it literally can't see them; if you were trained in the same way as GPT-3 you wouldn't be able to do them either.