Hacker News new | ask | show | jobs
by Widdershin 1275 days ago
Try to get chatgpt to solve a basic math problem using BEDMAS instead of PEMDAS, even with multiple interactions and reminders it still gets incredibly confused.
1 comments

ChatGPT cannot correctly perform step by step operations within strict formal systems. On the other hand, it can provide a high level sketch of how tomathematically prove something[1].

I think this is amazing, because this is the opposite of how we normally think about computers. ChatGPT is highly intuitive instead of a formal reasoning system. No doubt some future AIs will combine this intuition with checks against formal verification engines to check correctness.

[1] Section 6 of https://yaofu.notion.site/How-does-GPT-Obtain-its-Ability-Tr...