[MrPatan]

People take pills from known criminals, with high risk of fentanyl OD, just for fun.

Yes, I think people would indeed take pills prescribed by AI, just make it a robot wearing a lab coat.

Also pilots! I mean, pilots kill themselves and a planeload of people more than you think. Of course people would take black box ai that works.

[rvz]

The main difference is humans can be held accountable of these things, where as an AI system cannot be held accountable as it is not a human.

Accepting unchecked AI systems at scale as the future is plain fantasy in the view of regulator, especially in very high risk industries which is why it makes no sense for anyone to trust these systems without any assistance.