[alabhyajindal]

They don't do better as far as learning is concerned. Isn't this concerning?

> However, we additionally find that when access is subsequently taken away, students actually perform worse than those who never had access (17% reduction for GPT Base).

The abstract continues:

> That is, access to GPT-4 can harm educational outcomes. These negative learning effects are largely mitigated by the safeguards included in GPT Tutor. Our results suggest that students attempt to use GPT-4 as a "crutch" during practice problem sessions, and when successful, perform worse on their own. Thus, to maintain long-term productivity, we must be cautious when deploying generative AI to ensure humans continue to learn critical skills.

[madhatter999]

Relying on GPT while solving the problems must be inflating the grades (my use of the word inflate is intentional, because the evaluation does not represent the true knowledge of the student), which then results in lower retention in the long run.