[MattRix]

It seems like many of those issues would be solved by having a human write a comprehensive test suite, and then the AI would write an implementation that can pass all of the tests.

Eventually you could also have another separate AI that learns to generate the test suite itself from instructions given to it by a human (or even another AI!).

Most program implementations would not be perfect, but as we know, software written by humans certainly isn’t perfect either.

[ruchirpuri]

This is precisely how we do this in many other domains of automation. Specify a test set, and let the generator meet that test spec.