Hacker News new | ask | show | jobs
by johnfn 21 days ago
The guy was saying that AI was going to be a serious problem decades before anyone else was even considering it as a remote possibility. How is that in any way "consistently wrong with all their predictions"?
2 comments

>The guy was saying that AI was going to be a serious problem decades before anyone else was even considering it as a remote possibility

That's not accurate at all. AI research has been around since the 1950s and pioneers of the field identified risks early on, including Alan Turing, Norbert Wiener, and I. J. Good.

The problem with Yudkowsky is that he lays out elaborate doomsday scenarios with extreme confidence, except none of it is grounded in realistic physical constraints, timelines, or empirical data. It's all divined a priori from Yudkowsky's ad hoc "rationalist" principles.

You are saying 1) other people have said the same thing and 2) you don't like the particular way he said it. Those can both be true, but that isn't even close to "consistently wrong with all their predictions".
No, they didn't say the same thing. Identifying potential risks is not the same thing as confidently predicting the extinction of humanity.
We agree the guy roughly said AI will be dangerous. We agree AI is dangerous. Not sure what more there is to say here.
He made specific predictions about what problems AI would cause, not just a vague "AI will be dangerous". Those specific predictions were entirely incorrect; they both said that things would happen that didn't, and failed to foresee any of the actual problems with AI that have happened.
Yudkowsky said AI would be a problem when very few people taken seriously in the mainstream were saying it was going to be a problem. Saying "specific predictions are wrong" is missing the forest for the trees here.
Well, I don't agree AI is dangerous, at least no more dangerous than electricity or the Internet. But even so, saying that AI is dangerous is not at all an original or interesting thought, especially for a guy who started talking about it in the early 2000s. Go back and watch 2001: A Space Odyssey (1968) or The Terminator (1984).
The discussion isn't about whether it's an "original or interesting thought", it's about whether Yudkowsky is "consistently wrong with all their predictions". You keep shifting the topic.
Yah, another way of putting this is theory-ladenness of hyperreality of personal world model (rationality vs empiricism).
Has AI yet been a serious problem?
Yes, repeatedly, since well before this particular AI summer.

One previous attempt at AI was "expert systems", and while the term fell out of use it's functionally about the same as basically all modern business systems, and doing that wrong led to a lot of people being prosecuted for crimes they didn't commit: https://en.wikipedia.org/wiki/British_Post_Office_scandal

If you insist on learning systems, all AB testing counts, and from that we get meta making their products into hyper-stimuli for vulnerable teens: https://finance.yahoo.com/markets/stocks/articles/meta-meta-...

Even without that lawsuit, there have been various concerns that "the algorithm" (of Twitter/X, FB, Instagram, YouTube, Google, everyone) has propagandising biases that damage society. I don't know how to sift fact from politicking with that.

Horizon was accounting software - where is the connection to expert systems?

Sounds like corporations can have bad motivations, and can make bad software - no AI required.

> Horizon was accounting software - where is the connection to expert systems?

  "it's functionally about the same as basically all modern business systems"
> can make bad software - no AI required

All AI *is software*; and by the old definition of AI, almost all modern software *is AI*.

Disagree, words drift but they still mean things. Nobody building accounting software in the 90s called it AI (or even an expert systems, barring the most inventive salescritters).

Besides what kind of slippery slope argument is this? All software is AI, so if you do harm with software, AI is a harmful technology? Seems like a not very helpful model of the world.

Like, is all of statistics just basically AI, or is there a meaningful difference?
Pretty much the same, yeah; the maths of finding a decision boundary for a perceptron echos the maths for a line of best fit.