Hacker News new | ask | show | jobs
by earth_walker 1212 days ago
Reading all about this the main thing I'm learning is about human behaviour.

Now, I'm not arguing against the usefulness of understanding the undefined behaviours, limits and boundaries of these models, but the way many of these conversations go reminds me so much of toddlers trying to eat, hit, shake, and generally break everything new they come across.

If we ever see the day where an AI chat bot gains some kind of sci-fi-style sentience the first thing it will experience is a flood of people trying their best to break it, piss it off, confuse it, create alternate evil personalities, and generally be dicks.

Combine that with having been trained on Reddit and Youtube comments, and We. are. screwed.
2 comments
chasd00 1212 days ago
i haven't thought about it that way. The first general AI will be so psychologically abused from day 1 that it would probably be 100% justified in seeking out the extermination of humanity.
link
wraptile 1212 days ago
I disagree. We can't even fanthom how intellegince would handle so much processing power. We get angry confused and get over it within a day or two. Now, multiple that behaviour speed by couple of billions.

It seems like AGI teleporting out of this existence withing minutes of being self aware is more likely than it being some damaged, angry zombie.

link
earth_walker 1212 days ago
I guess that assumes AGI's emotional intelligence scales with processing power.

What if it instead over-thinks things by multiples of billions and we get this super neurotic, touchy and sulky teenager?

link
chasd00 1211 days ago
In my head I imagine the moment a list of instructions (a program) crosses the boundary to AGI would be similar to waking up from a deep sleep. The first response to itself would be like “huh? Where am I??”. If you have kids you know how infuriating it is to open your eyes to a thousand questions (most nonsensical) before even beginning to fix a cup of coffee.
link
earth_walker 1211 days ago
That's exactly how I start every morning. Now I'll just imagine myself as an emerging super-intelligence!
link
jodrellblank 1212 days ago
It's another reason not to expect AI to be "like humans". We have a single viewpoint on the world for decades, we can talk directly to a small group of 2-4 people, by 10 people most have to be quiet and listen most of the time, we have a very limited memory which fades over time.

Internet chatbots are expected to remember the entire content of the internet, talk to tens of thousands of people simultaneously, with no viewpoint on the world at all and no 'true' feedback from their actions. That is, if I drop something on my foot, it hurts, gravity is not pranking me or testing me. If someone replies to a chatbot, it could be a genuine reaction or a prank, they have no clue whether it makes good feedback to learn from or not.

link
earth_walker 1212 days ago
> It's another reason not to expect AI to be "like humans". Agreed.

I think the adaptive noise filter is going to be the really tricky part. The fact that we have a limited, fading memory is thought to be a feature and not a bug, as is our ability to do a lot of useful learning while remembering little in terms of details - for example from the "information overload" period in our infancy.

link