[bigstrat2003]

Yes, because they can't reason. This is well known, and should be completely unsurprising. LLMs don't "learn" anything except that some token is statistically likely to be followed by some other token.

[nh23423fefe]

cool assertion from 2023