[BoorishBears]

>Why does it need to be autogpt? It can rather create sophisticated plans for humans to exploit. Early nefarious use is more likely to go this route.

That'd be infinitely harder for an LLM: Problems where the context window can grow based on feedback of its actions (like automated attacks) are the ones that will be solved much much earlier.

The teams defending against attacks will be able to trivially apply LLMs in an automated fashion to finding mitigations, if you're already admitting it's going to be LLMs writing plans that then need humans to implement them, you're countering your own point...

> Intellectual knowledge and cyber capabilities will vastly outstrip physical manufacturing. These threats will likely appear long before this transformation occurs.

Right, so you're imagining the intellectual knowledge and cyber capabilities to trivially commit terrorism, but scarcity and equality are untouched because of manufacturing.

Sci-fi has really done a number on some people.

[13years]

> The teams defending against attacks will be able to trivially apply LLMs

Who are these imaginary teams defending against attacks? How does the LLM defend against another human who plans to target something that is not a LLM?

> if you're already admitting it's going to be LLMs writing plans that then need humans to implement them, you're countering your own point...

I'm just not limiting to only a single context. This is the very basis for jailing the current LLMs.

> Right, so you're imagining the intellectual knowledge and cyber capabilities to trivially commit terrorism, but scarcity and equality are untouched because of manufacturing.

Hardware revolutions always lag intellectual and cyber revolutions. Do you see that changing?

> Sci-fi has really done a number on some people.

Indeed