[scarmig]

The halting problem doesn't mean you can never decide if something cycles etc, just that you can't always decide.

As it stands, my guess is that the LLM would always confidently make a decision, even if it were wrong, and then politely backtrack if you pushed backed, even if it were originally right.