[visarga]

GPT-3 is a generator, that's just half the equation. It needs a discriminator (critic) to check out its outputs and in the case of program synthesis and realistic physics, a simulator. That's how humans do creative stuff - generate silly ideas then check them out.

[ZephyrBlu]

Sounds like maybe a GAN-like ML algo could be a good choice for attempting to do code generation.