Bingo. Humans can make mistakes, but they can also recognize that something's gone wrong and change tactics to recover from it. Current self-driving systems can't do that effectively; they'll just keep going, even when they probably shouldn't.
>Do they continue to drive that way if they have a passenger yelling, "we are on train tracks?"
On a non-separated rail like in the video where you can just turn off at any time I can see a lot of people continuing to do it just to spite their spouse for screeching about the obvious.
Or on the other side of the coin I can see a lot of people just say nothing because it's probably fine and they'd rather not have the argument.