|
|
|
|
|
|
by int_19h
1207 days ago
|
|
|
Arithmetic fail kinda makes sense when you look at how the numbers get tokenized. Try this: https://platform.openai.com/tokenizer Then imagine how well you'd be able to do even basic math if your representation of numbers was such that 2045 is made up of tokens (20,45) while 2145 is (2,145) and 2005 is just (2005). No wonder that whatever relationships it derived from the training corpus don't generalize well. |
|
|