Not sure about physics but I am really looking forward to see games with NPC characters powered by ChatGPT. That would make some game world really deep and involving.
ChatGPT lowers information complexity by smoothing and averaging the information content, so no, likely you'll see the opposite effect.
We already went through this with Stable Diffusion - the content it produces looks very professional, but also somehow exactly the same no matter the subject.
This assumes that you will have only a single model. I expected at least one model per race (elves, dwarfs...) x adversity (friend, enemy, neutral) x some psychological models (e.g. Jung personality archetypes). So with ~100 GTP models learned on different sets you may have a quite diverse army of characters.
ChatGPT also offers a possibility to e.g. have a real bargaining at the shops: "How much is that sword... ".
You miss the overarching point. Neural network AI's work by averaging information and making it smoother, whereas it's the uneven "bumps" that actually make art interesting. (This is why most artists add deliberate imperfections to their work.)
We already went through this with Stable Diffusion - the content it produces looks very professional, but also somehow exactly the same no matter the subject.