[hackyhacky]

This can been discussed to death, but AI killing us is not the only danger. It could destroy society by making us fall in love with it.

https://medium.com/@jbaxby/we-will-fall-in-love-with-ai-1869...

[edited for clarity]

[PaulHoule]

Human Feedback Reinforcement Learning is a fancy way to say “tell people what they want to hear” and there are few things more dangerous than that.

Imagine a lesswrong fanatic that makes his own personal Eliezer Yudkowsky and gets driven (completely in private) to murder an A.I. researcher.