[keyle]

I find it too mind boggling. But it isn't intelligence as you might find in a child, it's transactionally applying a corpus of knowledge and deciding what is best to say next, throwing in some randomness which makes it appear more human.

In many ways it simulates the human brain, shockingly well, but a dead human brain.

I'm really concerned about AGI now, when I see how much ChatGPT really is "knowing" more than I will ever do.

If a system with actual sentient feelings, needs, curiosity and eventually self-doubt was to go online, and never need to eat or sleep, it's only a matter of time until we become its pets.

[NumberWangMan]

Yep. Pets, or just one of many biological species that go extinct as more and more resources are taken up by AGIs doing what they want to do, remaking the planet to be more suitable for themselves and not terribly caring if it becomes less hospitable for us.

I expect that AGI is probably between 2 and 6 years away, with super-intelligence a year or two after that, if we don't make a concerted and coordinated effort to restrict access to computing power. So much of our brains are taken up with things like processing visual, auditory, and sensory input, muscle control, emotions, etc. To have a consciousness, you don't need as much processing power as we have -- which is a lot, but we're rapidly approaching it.