[13years]

> How many autogpt scripts can trivialize taking down the power grid?

Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route.

> We'd have a tool that's drive massive advancements that trivialize decentralized power generation, reduce scarcity, find cures for mental illness, improve equality.

Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs.

[BoorishBears]

>Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route.

That'd be infinitely harder for an LLM: Problems where the context window can grow based on feedback of its actions (like automated attacks) are the ones that will be solved much much earlier.

The teams defending against attacks will be able to trivially apply LLMs in an automated fashion to finding mitigations, if you're already admitting it's going to be LLMs writing plans that then need humans to implement them, you're countering your own point...

> Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs.

Right, so you're imagining the intellectual knowledge and cyber capabilities to trivially commit terrorism, but scarcity and equality are untouched because of manufacturing.

Sci-fi has really done a number on some people.

[13years]

> The teams defending against attacks will be able to trivially apply LLMs

Who are these imaginary teams defending against attacks? How does the LLM defend against another human who plans to target something that is not a LLM?

> if you're already admitting it's going to be LLMs writing plans that then need humans to implement them, you're countering your own point...

I'm just not limiting to only a single context. This is the very basis for jailing the current LLMs.

> Right, so you're imagining the intellectual knowledge and cyber capabilities to trivially commit terrorism, but scarcity and equality are untouched because of manufacturing.

Hardware revolutions always lag intellectual and cyber revolutions. Do you see that changing?

> Sci-fi has really done a number on some people.

Indeed