[mbork_pl]

> I'm a religious person myself, and my argument would be to not trust AI all that much. It is a creation by fallible human beings trained on fallible human data.

Good point. How is A.I. different (in this respect, and possibly in some other ones, too) from a really huge, partially pseudo-random spreadsheet?

We need to remember, though, that we live in a relatively small bubble where A.I. is perceived as (more or less) what it is. For a layman, both an A.I. and a huge spreadsheet may be similarly beyond comprehension.

I will always remember talking to a very nice old lady (it could have been about 25 years ago), who told me that computers can read people's minds. She saw someone type a few characters on a computer and suddenly a whole page appeared. Since she had a mental model of a typewriter (which has no memory), the logical conclusion of text appearing without a person physically typing it was that the machine read his mind. In fact, that made perfect sense!

We often have no idea how weird (from our POV) the people's mental models of computers are.

[debok]

Yeah, you make a good point. It reminds me of that Arthur C. Clarke quote: "Any sufficiently advanced technology is indistinguishable from magic." I guess if you see AI as something magical, it could easily start occupying a religious or God-like space in your psyche.