Hacker News new | ask | show | jobs
by gwmnxnp_516a 1174 days ago
It does not happen only with Banks, there are many cases where innocent people, that are flagged by fraud detection machine learning algorithms in social media or any kind of service, are banned or have accounts frozen without any explanation or warning due the false positives results or bias in the machine learning algorithms. In lots of cases, companies operating fraud detection algorithms don't provide any way to appeal and do not have any human in the loop for reviewing the decisions taken by the algorithm due cost saving or scaling. In general, no explanation is given to a person flagged by the algorithm in order to not disclose how it works or help bad actors. In the case of financial institution, other reason for no giving explanation is the legal AML requirement that forbids financial institutions from telling a customer that he or she was flagged. It is becoming a Kafkaesque world, the AI is more and more making decisions about our lives without due process and right to appeal/recourse.

Here some similar case:

  - AI tool flagged parents with disabilities: https://apnews.com/article/child-protective-services-algorithms-artificial-intelligence-disability-02469a9ad3ed3e9a31ddae68838bc76e

  - https://www.theguardian.com/technology/2022/aug/07/ai-eu-moves-to-beat-the-algorithms-that-ruin-lives

 - https://ico.org.uk/for-organisations/guide-to-data-protection/guide-to-the-general-data-protection-regulation-gdpr/automated-decision-making-and-profiling/what-does-the-uk-gdpr-say-about-automated-decision-making-and-profiling

 - U.S. warns of discrimination in using AI to screen job candidates : NPR / https://www.npr.org/2022/05/12/1098601458/artificial-intelligence-job-discrimination-disabilities

 - Finding it hard to get a new job? Robot recruiters might be to blame | Work & careers |/ https://www.theguardian.com/us-news/2022/may/11/artitifical-intelligence-job-applications-screen-robot-recruiters

 - https://www.vice.com/en/article/jgq35d/how-a-discriminatory-algorithm-wrongly-accused-thousands-of-families-of-fraud

 - Handling Discriminatory Biases in Data for Machine Learning - by Matthew Stewart, PhD (it shows how to make ML algorithms fair) / https://towardsdatascience.com/machine-learning-and-discrimination-2ed1a8b01038