[drivebyhooting]

Can LLMs design and build a chip foundry to manufacture semiconductors? No?

Can LLMs design and build the reactors to enrich uranium, breed plutonium, and construct nuclear weapons? No?

Can LLMs design and manufacture Shahed drones? No?

There are already super intelligences at large with “scary capability”. And yet the word hasn’t ended.

[metabagel]

Super-intelligent AI will probably be pretty good at manipulating people.

This sci-fi podcast posits a future where The Program has taken over society. It started out as an application for assigning gig work. Eventually, it began to assign gig work for people to act on behalf of its own interests, such as self-protection.

https://programaudioseries.com/

[shimman]

Current brain dead level memes and political outrage is already doing a good job at manipulating people. Why do you need a machine that makes this process 1000x more costly?

[kurthr]

Can LLMs convince a human who has power over each and everyone of those things to use them for a(n unstated) prompts goal?

Yeah, probably over 50% of the population already, and if not many of the rest soon.

[kurthr]

It's fairly hilarious in a dangerous way, how confident people are that neither they, nor their boomer parents could be fooled by a persistent LLM with access to their mail, text, voice, and that of their co-workers and supervisors. The social engineering attacks have always been a weak point, and now they can be combined with other information to target individuals and fake voice/sms tone.

Look at what happened on r/changemyview. That was over a year ago, using only text, and not only went undetected, but was highly effective at changing opinions.

https://www.reddit.com/r/changemyview/comments/1k8b2hj/meta_...

[thrance]

> probably over 50% of the population

On which end of this split do you place yourself? Most people believe they're smarter than average [0].

And have some more respect for your fellow human, please.

[0] https://pmc.ncbi.nlm.nih.gov/articles/PMC6029792/

[georgemcbay]

> And yet the world hasn’t ended.

...yet

But we only need things to spiral out of control one time for that to change.

The world as we understand it would have ended if Vasily Arkhipov didn't veto the decision to launch a sub nuke during the Cuban Missile Crisis.

Is an emotionless AI system in his place ever going to make the same decision he did?

How confident are you we won't put an AI system in his place, particularly when we have to assume if we don't others will?

[drivebyhooting]

Sounds like your fear is not of artificial intelligence but artificial incompetence. That’s a very different position from the AI doomers.