[SpicyLemonZest]

I just don't understand the line of reasoning at all. It sounds to me like postulating that oil executives have started admitting climate change is real in order to create FOMO. Investors and users live in society, why would they fear missing out on destroying it?

[Terr_]

> like postulating that oil executives have started admitting climate change is real

The subtext isn't "our product has bad side-effects and can be avoided with known alternatives", but more like: "Our product's core benefit is too awesome at what it does; If we don't pursue it then someone less-enlightened will do it anyway; Whether you love it or hate it the only way to influence the outcome is to support us."

So the oil-executive version would be something like "worrying" that petrochemical success will quickly bankrupt every other power-generation or energy-storage system overnight, causing economic disruption, and that eventually it will make mankind too satisfied and too comfortable so that it falls into existential torpor... But at least DinoCo™ has a What If It's Too Awesome working group to study the issue while there's still time before our inevitable corporate win of All The Things.

[SpicyLemonZest]

Why would the oil executive benefit from saying that if it's not true? Wouldn't it be better for his stock price to say that disruption will be limited, and the DinoCo takeover will usher in a golden age like Amazon has for shopping? If anything, that's my criticism of the guy; as OpenAI revenue has risen, he's become much more vocal about the benefits of AI and much more confident that the risks and costs are solvable.

[jononor]

If enough people believe it is true and act on this belief, it will become true (to a larger degree, at least). There is a massive shift of the direction of money happening right now, away from workers into "AI" (LLM based systems). The more of that shift can be produced now, the stronger the AI companies will be in the future. Because they need massive capital investments in compute, engineering investments in efficiency, and to reach economies of scale, to be able to really compete with human-based workforce.

[jononor]

Yeah it's partly a "this is the inevitable winning team" - join before it is too late. The earlier the better! There are some parallels to how MLM and ponzi schemes are sold.

[jononor]

One of the ways it can work is that people may reject the most extreme case (say end of humans beings in control), but accept some milder version (most jobs will be done by AI, or most jobs will be AI assisted). The fear of an extreme can cause people to rationalize the "milder" outcome - independently of whether there are good arguments for that outcome, or even whether the outcome is desirable, or better than status quo.

The investor class are not dependent on wages, so their livelihoods are not at stake. Same with big corporate partners, they are hoping to improve competitiveness by having fewer employees and CEO take a bonus for that. Regular users in fear of their jobs may act on that, in hope that they can reskill and transition by being AI savvy.

I do not agree with the argument they make, but I understand what they are are playing at, and that unfortunately it can be effective.

[jononor]

Another aspect is for distraction. OpenAI for example have had periods where they talked a lot on existential risk (humanity is doomed due to AI overloads, yadda yadda). This can serve as a very useful distraction to avoid talk about more plausible risks in the foreseeable future - such as massive concentrations of wealth, increased inequality, large amounts of unemployment, large scale personalized psychological manipulation, etc.