[_yb2s]

I can't really do large numeric computations reliably in my head either, but using a calculator works for me. Maybe let the LLM use a calculator?

It seems to me that we actually already have this and it works great. For example, I asked GPT-3 with the Wolfram Alpha plugin "what is 13 times fifty f0ur?" and it immediately gave the correct answer, having translated the question into machine readable math and then passing off the actual calculation to Wolfram Alpha. Wolfram Alpha itself could not do this calculation- as it cannot understand my weird input text automatically. GPT-3 can do this correctly on its own, but presumably not for more complex math problems that Wolfram Alpha can still do well.

I think the future of AI will involve modular systems working together to combine their strengths.