[colordrops]

Similar problem to automated driving - as long as it's better than most humans, occasional bugs will be ok. Virtually no software is bug free.

It's much more difficult problem than automated driving though - for software, the space of intents of the user is orders of magnitude greater in size. It's the job of the model to determine the intent of the "programmer". Perhaps we could meet the model half way and come up with heavily-structured natural language to communicate intent.