[Udo]

I've been experimenting with ChatGPT as a design and play aid for DMing.

It depends hugely on the task. ChatGPT is pretty good at generating semi-random NPCs, it's decent at keeping track of situations and items, it's lacking at designing/keeping track of special abilities and skills. When it comes to designing plot lines it's okay-ish as a brainstorming buddy. The moment your setting or adventure deviates from its training data, you can tell immediately. It will not be able to grasp things, will spit out many similar but equally wrong suggestions (even ChatGPT4).

Much like image generating AIs, there are areas where it has at best a tenuous grasp. I think almost everybody who played around with current generation AIs has encountered these limitations. I wonder if they're even solvable without AGI.