[My_Name]

You said "they reproduce what they're trained on"

The problem was unsolved, it solved it when it was not possible for it to be trained on the solution, therefore your other claim that "they're always going to produce the most "average" code" does not hold up, they can come up with better code than they were trained on precisely because they can apply known techniques to write better code than existed in their training data. The book you have is out of date and does not apply to recent improvements in the field.

The unit distance problem had no known answer and no roadmap. The model identified the problem, chose its own approach, and produced the proof.

I am not convinced by either your logic or your argument from incredulity. Neither prove your position.