[FeepingCreature]

> a concept that has been given additional, undeserved credibility by the reactions of Yudkowsky and LW.

For the record, EY agrees with you and says he mishandled the original comment. Also for the record, the reasons why the Basilisk does not work are _not trivial_ - it's not a simple Pascal's Wager, because with Pascal's Wager, we don't have the ability to actually create God.

> I have no problem with that thesis. What I object to is the "magic trick" aura surrounding this experiment, including the insinuation that at the core there is an argument so profound and unique and potent, it cannot be allowed to escape Yudkowsky's head.

Personally I never got that impression. My idea, from looking at the psychological state of Gatekeepers and AIs after games, was always that playing as AI involved some profoundly unpleasant states of mind, and that not publicizing the logs probably comes down to embarrassment a lot.

For the record, Eliezer never claimed to have "one true argument", and in fact publically stated that he won "the hard way", without a one-size-fits-all approach. A lot of the mythology you claim is utterly independent of LessWrong.

> Oh, and by the way, the trick can never be repeated, but all you laymen out there are welcome to devise your own version at home.

It probably helps that I've met other AI players, and their post-game state matched EY's.

I think in summary you're mixing up stuff you've read on LessWrong and stuff you've read about LessWrong. The latter is often inaccurate.

[Udo]

> I think in summary you're mixing up stuff you've read on LessWrong and stuff you've read about LessWrong. The latter is often inaccurate.

That may well be the case, but my only other information source is HN comments, and not those made by detractors either. If there are sites or articles dedicated to the deconstruction of LW ideas, I'm not privy to them, nor am I interested in seeking them out. Basically, I only remember LW's existence when it comes up, always accompanied by fawning comments, on HN.

> the reasons why the Basilisk does not work are _not trivial_ - it's not a simple Pascal's Wager

Correct. While my value judgement of both is the same, my reasoning about why the Basilisk is not a thing ultimately consists of more components. That doesn't mean it's worthy of more consideration though.

> because with Pascal's Wager, we don't have the ability to actually create God

I would not say this is centrally important, because the processes leading to the creation of AGI are in all likelihood not going to be influenced by the existence of the Basilisk thought experiment either way.

> and in fact publicly stated that he won "the hard way", without a one-size-fits-all approach.

Again, I have to take my cues from the perspective of an outsider looking in, and there are several people who commented in this thread alone who described it very, very differently. Of course, a movement is not directly responsible for all its fans and members - but among the advocates for the validity of the AI Chat experiment, the idea that out there is a mystical one-size-fits-all rhetorical exploit seems very much alive. It may be cynical, but I can't help noticing how this aura of mystique and secret knowledge seems to work very well when it comes to attracting fans.

Of course, ultimately, these are just memes - and like many memes they propagate best when reduced to an absurd core. It doesn't even require intent.

[FeepingCreature]

> Of course, a movement is not directly responsible for all its fans and members - but among the advocates for the validity of the AI Chat experiment, the idea that out there is a mystical one-size-fits-all rhetorical exploit seems very much alive.

I agree, and I am totally with you on this - I disagree with that interpretation wherever I see it. :) That's not exactly Eliezer's fault tho, and I guess it's to be expected that geeks attach to "clever" answers. I do think it's a bit unfair to judge the entire site by the two posts out of hundreds that happen to be in all the news articles - which LW has no influence on.

Inasmuch as _fans_ judge the site by these two articles, I'm just as much against that. I don't want LW to have an aura of mystery; that largely defeats the point!

[edit] I think a big part of the problem is that online reporting selects for clickbait.

[Udo]

I'm thankful you took the time to engage with me and explain things from an insider perspective (instead of just downvoting me like the others did). You are absolutely right that the entire site shouldn't be judged on two "meme-affine" topics and headlines, which I hope is clear was never my intention. You provided some insight into these two subjects that irked me where nobody else in this thread could or would step up. I find the nature of the HN-based fanclub still bothersome, but I do see a larger disconnect between unreflected fans and actual LW members now.

[philh]

> instead of just downvoting me like the others did

FWIW, I downvoted your original comment on this thread (and only that one) for being vague, snarky and dismissive. If you wish people to engage with you, I recommend not starting off like that, although it seems to have turned out okay in this case.

[Udo]

> If you wish people to engage with you, I recommend not starting off like that

And I recommend you give people the benefit of the doubt, though honestly I have to say I frequently fail at that myself. For example, your comment could be perceived as somewhat condescending, but I force myself to categorize it differently. I also know that I can come across way more negative than I intend to, I apologize for that and I'm working on it.

For what it's worth, I do think my original comment was snarky and dismissive, but somewhat counterintuitively that's not usually what gets people downvoted and flagged on HN. People can and do get away with artful personal attacks on HN all the time, at least in my defense I can say I attacked an idea instead of a person.

It may well be the case that my insufferability amplified the reaction, but I posit the root cause was disagreement about the message, not its format.

> although it seems to have turned out okay in this case.

It turned out okay because a decent dialogue emerged from it, one of the very few in this entire thread. But it was sufficiently controversial to get enough downvotes in order for my comments to teeter around 0 points and also receive flags. There have been a few updates to HN's comment ranking and voting algorithms that will make me regret taking this stance for some time, which may or may not provide you with some comfort to know.

[FeepingCreature]

Yay! Thanks for listening :)

[edit] To be honest, I didn't even know you could downvote on HN. I've never seen a downvote button.

[edit] Not that I would have.

[Udo]

> [edit] To be honest, I didn't even know you could downvote on HN. I've never seen a downvote button.

It's offtopic, but when you reach 500 karma (or thereabouts), you get the ability to downvote the comments you feel are a net-detriment to the discussion. Sometimes, when I express a particularly unpopular opinion I also get flagged. The result is what I call "the doghouse", it causes comments to sink to the bottom like stones for a few months, among other things. HN moderation has hidden mechanics and the results can be very frustrating. But in 99% of cases, when those special mechanics are not in effect, the system works pretty well.