[FrustratedMonky]

> LLMs are not capable of symbolic reasoning[0]

Despite the citation. I think this is still being studied. And others have found some evidence that it forms internal symbols.

https://royalsocietypublishing.org/doi/10.1098/rsta.2022.004...

Or maybe, can say, an LLM can do symbolic reasoning, but can it do it very well? People forget that humans are also not great at symbolic reasoning. Humans also use a lot of cludgy hacks to do it, it isn't really that natural.

Example often used, about it not doing math well. But humans also don't do math well. How humans are taught to do division and multiplication, really is a little algorithm. So what would be difference between human following algorithm to do a multiplication, and an LLM calling some python to do it. Does that mean it can't symbolically reason about numbers? Or that humans also can't?