[ermir]

Rule of law differs substantially from rule by algorithms since laws are created and interpreted by humans, and there's always the possibility of reasoning and making a deal with a human when the law is incorrect or there are specific circumstances. In rule by algorithm, you get a situation where "Computer says no", and there's no recourse, no deal to be made, nobody to reason with.

An entire society can be bootstrapped to be entirely run by thoughtless algorithms and it could end up in a situation where there's no way in to untangle the dependencies that these systems have with one another.

[gampleman]

Whether and what recourse is available is pretty orthogonal to whether the thing is run by computers or humans. In practice it is likely to be a mixture of both these days, as we don’t really have sufficient technology to run a real society, and most countries today take heavy advantage of automation.