[BobbyJo]

I do think that LLMs have emergent properties that do some interesting things, however I would like to point out simple next token prediction would work on your example quite well.

<numbers>0 + 1 -> <numbers>1

Even simple attention mechanisms would handle that quite well with enough examples of <numbers>

[doctor_eval]

I agree with you, but it also works for

    4320598340958340958340953095809348509348503480958340958304985038530999999 + 1 ?

    The sum of 4320598340958340958340953095809348509348503480958340958304985038530999999 and 1 is 4320598340958340958340953095809348509348503480958340958304985038531000000.

which is more complex.

I'm too lazy to get it to add two large numbers together.

Also, I've never been convinced that "ability to do arithmetic" has any relationship to intelligence. We don't expect regular humans to be able to add two large numbers together reliably, either.