[henearkr]

Of course you can!!

Even in something not very well defined as a neural network, you can try to retrain it, or also to modify its architecture, or its postprocessing, and verify reproductibly on test cases that it behaves better.

Also, to address your critics, you can add test cases (just like in any sotware. But actually they also do exactly that for hardware too).