Hacker News new | ask | show | jobs
by callmekit 1661 days ago
Do you know how previously unseen numbers in the prompt are encoded, probably the same way? Then GPT3 can not do any math at all, unless the specific numbers were seen before?
1 comments

The quote above referred to exact copies of the problems, not individual numbers. And the abysmal success rate on four and five digit numbers does suggest it has trouble on rarer numbers.