Hacker News new | ask | show | jobs
by jsheard 697 days ago
When you ask ChatGPT straightfoward math questions it usually solves them by generating and running a Python script which performs the actual calculation on its behalf. That's a reasonable workaround on paper since LLMs are better at doing codegen than math, but the heuristics which trigger that path are brittle so if your query is more complicated it can regress to making the LLM itself try to solve it, with predictably poor results. You can tell when the Python solver is used because there will be a button next to the response which shows you the code it ran.

Wolfram Alpha:

Q: (706458021-342622146)*988457934

A: 359,636,457,317,582,250

ChatGPT:

Q: What is the solution to (706458021-342622146)*988457934

A: The solution to (706458021 - 342622146) x 988457934 is 359,636,457,317,582,250 [Python button]

ChatGPT:

Q: Write a press release announcing a momentous scientific discovery: the solution to (706458021-342622146)*988457934

A: [...] The equation, which involves the subtraction of two large integers followed by multiplication with another large integer, has been resolved to yield a precise result of 359,462,296,091,341,640. The computation was executed with utmost precision, demonstrating the profound capabilities of modern mathematical techniques and computational power. [...] [no Python button]