[fennecfoxy]

Yeah, good point too. I guess that's also the goal of autonomous driving.

If a human makes a decision that the model balks at, but has to perform anyway, who's at fault? Is this good functionality?

Inevitably a bad human made decision that overrides a machine's good behaviour will be attributed to the machine, anyway; it's human nature to avoid blame. But that's where decision logs come into play I guess.

I 100% think we'll get to the point where machines are just making all the decisions, though. Us meat bags will just get an after-action report, decisions will be made too quickly and our slow meaty brains will only negatively affect outcomes. But our slow, meaty brains should be used to enforce our ethics/moral principles on war machines at training time, at least.