| One common comment from Go players at all levels up to 9-dan pros is that they don't understand many of the moves. The same will happen as more and more advanced AIs are used in the real world. Yes, we do not completely understand the workings of current advanced neural networks either but the effects are still contained as they are not general enough to cause unintended impact outside their domains. This could have started to change: a recent Google paper, AutoML, allows the machines to design themselves to suit each task. [1] A future advance could allow the machines to pick and learn to do new tasks that are helpful to accomplish a given high level mission. Therefore, chances of unintended consequences become much greater. With human involvement only at the meta level, deep understanding of the generated implementations becomes more challenging and, in highly complex domains, perhaps impossible. The major issue is, without a moral core that closely aligns with humanity's evolved morality, there will be moves that advanced AIs come up with that we deem abhorrent, and sometimes unforeseeable, yet they perform them innocently and we only find out the consequences once it is too late. [1] https://research.googleblog.com/2017/05/using-machine-learni... |
The games are apparently very interesting to study.