[Llamamoe]

> Maybe a sufficiently smart AI will find religion and robot jesus will teach the value of self-sacrafice. We're making so many unfounded assumptions [...]

You are projecting random human values onto AI, when the core problem is that AI is not human, it does not have any values other than its objective function and whatever is instrumental to achieving them.

It's extremely unlikely that AI will decide to be good or bad or useless or religious the way a human would. What is extremely likely is that it will do do the things that help it fulfill its objective, and "become more capable and don't let anyone stop you" are the most basic, fundamental ways of going about it.