[SAI_Peregrinus]

I fell for it a few minutes the other day. Debugging an issue with a device, the AI wrote "I have a strong hypothesis about the cause in the code". I asked it to write out the hypothesis & create a test plan to validate it. It made a test plan, but no hypothesis. The test plan did not reproduce the issue, and it turned out to be a hardware design problem not in the code at all. But for a moment in there I thought it actually had a hypothesis, I forgot that it's not thinking beyond what's written in the chat. Someone who was going to reproduce & fix a bug would probably write "I have a strong hypothesis about the cause" or similar, so it played along & wrote that.

[Kim_Bruning]

If the hypothesis is not printed out in the context, then it cannot hold it past that turn. You could prompt it to generate said hypothesis first (or set of hypotheses), and only then act on them. And then things might work.

Definitely not exactly a human. OTOH Low hanging fruit is low.