[piokoch]

Thanks for the very interesting write up, I am teaching management studies programming Python (people who want to be quants, dana analysts, etc.) and I am struggling with the same problem - how the hell do grading to make it reliable.

LLMs has become good enough so whatever homework task I give, it can be solved easily by any LLM (and, in fact, this becomes unfair to those who are not able to pay for good model). I was asking to add comments & interpretation of results, this slightly helped, but LLMs are increasingly good in all this as well.

So, quite seriously, I am considering some on paper tests & quizes, because what else can be done?

Making people aware about importance of writing code is indeed a good hint to convince, at least part of the people to do this. Another thing is: they will leave university one day, they will search for employment and the employer might be much more hostile towards cheating during job interview and can easily make cheating with AI impossible... Question is, will it still matter?