At best, this is a way to sweep unaccountable decision-making under the carpet of "the software said so". Quite likely, though, is that such products will make society a living hell for everyone until these practices are entrenched in the industry and it is too late to roll it all back.