[ProblemFactory]

> that only speaks when spoken to

Feedback loops are an important part.

But let's say you take two current chatbots, make them converse with each other without human participants. Add full internet access. Add a directive to read HN, Twitter and latest news often.

Interesting emergent behaviour could emerge very soon.

[dTal]

Worse, you need only plug a chatbot into itself, with some kind of basic bash script and very simple "goal prompt", and suddenly you get an agent with long term context. You could do that today. I don't think people realize how close these generic undirected intelligences are to unpredictable complex behavior.

A sobering intuition pump: https://www.lesswrong.com/posts/kpPnReyBC54KESiSn/optimality...

[lunarhustler]

man, these lesswrong people sure do have some cool ideas about how to apply GPT