Hacker News new | ask | show | jobs
by cmorez 1430 days ago
> at least understand the concept.

GPT-3 is absolutely capable of understanding addition. It's handicapped by BPE's (so unless you space out adjacent digits the tokenizer collapses them into one token). But if you space out tokens and explain the concept, it gets it.

https://lingo.csail.mit.edu/blog/arithmetic_gpt3/