[felipeerias]

LLMs are very sensitive to leading questions. A small hint of that the expected answer looks like will tend to produce exactly that answer.

[giantrobot]

You don't even need a leading direct question. You can easily lead an LLM just by having some statements (even at times single words) in the context window.

[SAI_Peregrinus]

As a consequence LLMs are extremely unlikely to recognize an X-Y problem.