[ethanbond]

No, and in fact if we rewind the clock a mere 12 months ago one of the primary arguments against AI “worriers” was “of course we wouldn’t connect it to the internet before it was safe!”

Other gates we blew right through include, “we wouldn’t…

1. Connect it to the internet

2. Make it available to the public

3. Let it write and execute code

4. Connect it to physical C&C systems

5. Let it have money

6. Let it replicate itself

7. ”Allow” it to lie/deceive

[ImHereToVote]

What's the worst thing that could happen? Extinction of all biological life in this solar system? Please.

[sdwr]

Love this, couldn't be happier. Hear so much about potential risks. Take our jobs blah blah end of life on earth blah skynet etc..

What about the singularity and/or giving birth to a new form of life?

[ethanbond]

Yeah same opinion for me w/ nuclear weapons.

Pretty cool to turn a planet into a sun temporarily!

/s

[VectorLock]

You've been able to do that for a while, just depends on how large scale you want to get. Been doing it since the 60s.

[ethanbond]

Right, and that’s bad

[VectorLock]

Nobody complained to Farnsworth.

[drdeca]

"disneyland without children"

[kfrzcode]

it's not really able to make curl requests it can just generate it

[ElijahLynn]

At least with GPT-4, you can use [input from https://www.example.com] to feed it input to analyze, if you do it twice it will automatically compare both sources. You can then even say "compare in a table". So, maybe not curl but definitely doing requests.

[FrojoS]

Well, it seems trivial to write a program that uses GPT API and curl request to feed GPT. Or am I missing something?

[kfrzcode]

left to it's own devices I reckon it'd be a real feat to generate a GPT-based tool that takes over the world. What prompts? What's the most impressive thing?

Say we had a GPT bot that built it's own social media, somehow. How did it get there? what was the initial prompt? "write to yourself via this api to figure out audience growth until you gain 100k followers then wait for further instruction, use any tool and leverage this name and credit card number if you need to pay for any tools or supplies"

Idk just brainstorming really have no idea what it'll do. Will build this weekend and see what happens I guess.

[maxwell]

Reminded me of this scenario: https://nautil.us/the-last-invention-of-man-236814

[ChickeNES]

Thanks for sharing this! I looked for it before but couldn't remember the article name or source.

[dwohnitmok]

https://www.lesswrong.com/posts/kpPnReyBC54KESiSn/optimality...

[ramraj07]

Where did we let it replicate?

[tough]

ARC Team https://arstechnica.com/information-technology/2023/03/opena...

[PoignardAzur]

Wait, the ARC team didn't do their tests in a closed network? And they had it interact with actual people?

That's... well, it's probably fine given what they knew about the model capabilities, but it's a pretty crappy precedent to set for "protocol for testing whether our cutting edge AI can do large-scale damage".

[ethanbond]

I don't think we should assume they know about their capabilities. They seem surprised with each iteration too.

[ramraj07]

I missed that detail from the system card pdf. That was beyond stupid. There’s a marginal chance it’s already secretly replicated out of their environment.

[eternalban]

Energy + matter + design => Baby AI. "CnC". "Money". "internet".

AI's startup will be strictly wfh ;)