[kirkules]

Sure, an LLM based tool may happily double down on a wrong position, and articulately address a student's concerns in doing so, possibly hallucinating convincing evidence.

[burnished]

Human tutors have this same failure mode. And at that point its pretty easy to have people come to the teacher when things get squirrelly in any way.