[guard-of-terra]

The problem here is trusting the machine and not trusting the actual human and not giving human any leverage to do anything extra.

In all cases where machine and human are assigned to a job as a unit, human should have authority to override automated decisions.

There are two reasons why it isn't so: business doesn't trust its drones, and workflow tends to break down on unexpected input. But it should be.

[TeMPOraL]

With full audit trail of the overrides that makes sure the human gets sacked if they fuck up, sure. I dislike limiting human agency, but unfortunately, most employees aren't True Believers of the Corporate Cause, so you can't assume they'll be loyal and diligent all the time.

[guard-of-terra]

Full audit trail is the first thing you should put in when building a back office system.