[lottin]

But how do you know it's given you the correct answer? Just because the code appears to work it doesn't mean it's correct.

[adwn]

But how do I know if my hand-written jq query is the correct solution? Just because the query appears to work it doesn't mean it's correct.

[lottin]

Because I understand the process that I have followed to get to the solution.

[ogogmad]

It can explain its solution. Point to relevant docs as well.

[gf000]

It can also very convincingly explain a non-solution pointing to either real or hallucinated docs.

[ogogmad]

You need to look at the docs.

[freehorse]

Omg this is how llms used to trick me inventing out all these apis.

[ogogmad]

Look at the docs it links to.