Hacker News new | ask | show | jobs
by gwern 1125 days ago
> It should be interesting to followers of EY because all of these traits are things that cult leaders do

It's not really because it's glib pattern-matching. It's roughly "Is the NIH a cult?" https://www.michaeleisen.org/blog/?p=1217 level. Go compare Eliezer to say, NXIVM, to see what a real cult looks like.

> It's made me very sad to see extremely smart people, who I once looked up to and really found very interesting (you're included in here!) fall victim to the irrational fear of AI spurred on by Eliezer. You can create as much literature as you want, and you can create as many hypothetical scenarios as possible, but it's not going to change the fact that dedicating your life into controlling AI so that you can "logically" justify your own life is nonsense...You're an extremely smart person. I love your blog posts, and I love the depth and time you put into them. It's incredible how disappointing it is for me to see you become another "rationalist" obsessed with a fantasy of AI doom.

I feel I should point out that you have not seen me 'become another rationalist' because this is what I have been since around 2004, long before I started any writing or even was 'gwern'. 'AI doom' has always driven my writing (even if I sometimes wander quite far afield before eg. concluding that nootropics are a dead end for intelligence augmentation that might help with AI risk - on the bright side, I think DL scaling may have helped answer why nootropics have been such a bust in general). I just thought we'd have way more time.

> Someone who is wealthy and has nothing to lose quitting his job to join the cult of AI doomerism is, in no way, proof that AI xrisk is meaningful. I trust you are smart enough to know why this is awful logic.

'some wealthy dude' is not the relevant description here for Geoff Hinton. I trust you are smart enough to see the problem with your even glibber comment there.