[mirakyanmartin]

We did a couple of tricks to get good suggestions from the model (although some of them were changed later):

1. We tried to generate several explanation + code samples with the model. After which the code was parsed and evaluated with the judging system. Finally, only the code that would yield a correct result after the evaluation would be shown to the user. This was actually modified in the latest release we made.

2. We prompt different types of responses - suggestions on how to modify the code, suggestions of completely new ideas, and suggestions on which parts of the code to fix exactly.