[jmiskovic]

The issue being raised is that while individual black boxes can be understood, the whole system (interaction between boxes) has become too complex and too fast for human cognition. Automation solves it only for unchanging conditions. Automation could also spiral out out control when only optimization metrics are profit seeking.