[phagenlocher]

I don't find that surprising, as LLMs typically predict the next token in a string of tokens not the previous. Just because we, as humans, have the knowledge that "is" can be a symmetric relation does not imply that LLMs have this knowledge.