[kristov]

That's a really great point. General Artificial Intelligence doesn't look like human intelligence. I guess that's the fear: we have never met another general intelligence before. We may as well be about to meet alien intelligence. One that is not constrained by a moral or social framework, and can copy itself at will.

[tayo42]

Are other animals on earth not generally intelligent? Dogs octopus, monkeys, dolphins. They have social structures and can problem solve.

[snowwrestler]

Good time for the classic line by Douglas Adams:

> For instance, on the planet Earth, man had always assumed that he was more intelligent than dolphins because he had achieved so much—the wheel, New York, wars and so on—whilst all the dolphins had ever done was muck about in the water having a good time. But conversely, the dolphins had always believed that they were far more intelligent than man—for precisely the same reasons.

[dotnet00]

They're certainly not general intelligences of an average adult human level (limited abstract reasoning ability, limited ability to transmit their reasoning), which is typically what is referred to as AGI.

[mtlmtlmtlmtl]

Maybe that is typical, but it's not correct.

A lot of animals do possess general intelligence in the sense that they can adapt to a wide range of different situations(within what they're physically capable of).

Involving "human level" in this definition just makes it much more poorly defined.

[dotnet00]

It has always been pretty vague, it's hard to define a proper bar for intelligence let alone the intelligence of any specific animal. We just don't understand intelligence well enough (which is why in my opinion Zucc saying they want to work on AGI is at the level of if Musk or Bezos came out saying they want to work on FTL travel).

[fullstackchris]

you dont think a super intelligence will inherit any amount of moral or social framework from being trained on data that is 100% from humans?