[sho]

> they do not prove that general ai is possible

Is there anyone who seriously believes that AGI isn't possible? I thought the only argument was about the timeline. To me it's absolutely inevitable, even if it may not be in my lifetime. I mean if we really can't do it with computers, then we'll just genetically engineer a giant brain in a vat or something. Still artificial! But unless you have some convincing evidence that human intellect is at the very limit of some speed-of-light-like universal constant, you bet we'll build something better. Eventually.

All of these articles basically make me think of a newspaper in 1915: "What if human flight is a failed dream?" Just wait, buddy. Rome wasn't built in a day, or even a decade.

[cat199]

Doubter here..

a) For AGI - I personally think there is an intellectual limitation in the human to go to this point. Case in point: Dogs can't talk. Arguing the 'inevitability' is to some extent arguing that one day dogs will be able to talk, because why shouldn't they? Will we make 'general AI' close enough to fool many people many times, which is essentially composed of a bazillion cogs wired together and rigged to appear general? probably. But to the level that it meta-tunes itself? no.

b) For your 'engineered brain': If you are mimicking natural intelligence with chemistry, biology, etc, it is a clone - you are still dependant on understanding natural processes which you didn't create, so it is only a clone and not at all 'artificial'.

If you'll notice, the philosophical limitations of 'b' are somewhat the same as 'a' - e.g. copying processes that already exist manually is not the same as creating it from scratch..

[sho]

> arguing that one day dogs will be able to talk, because why shouldn't they?

You misunderstand how evolution works. Humans are the product of over 10 million years of brutal selection pressure in favour of intellect. Before that, we indeed had about the same vocabulary as dogs (you should really say wolves, by the way - dogs are our invention).

If wolves/dogs were subject to the same pressure, then there's no reason why they would not eventually adapt in the same way humans did. However, humans got there first, and have so thoroughly colonised the earth that there is no chance of this happening.

> But to the level that it meta-tunes itself?

Well, you're extending AGI here into some kind of singularity runaway intelligence explosion. That's not within the scope of my argument. I have no opinion on that.

> it is only a clone and not at all 'artificial'

In my view, anything that is not naturally occurring is artificial.

[calafrax]

There is good reason to think that ML style techniques won't work.

The problem is that computers have long since surpassed human computational capabilities by orders of magnitude but the increased computational abilities don't make them much more intelligent.

For a computer to identify objects in a picture, with sub-human accuracy, it must be trained on a dataset of billions of photos and get massive amounts of human feedback to tune its algorithms.

The human mind can perform the same task with a sample data set many orders of magnitude smaller.

This would tend to indicate that the mechanism being used by ML is not the same mechanism as the brain uses or is vast inferior by many orders of magnitude.

The further computational power increases without producing intelligence the less likely it is that raw computation can produce intelligence.

[ifdefdebug]

It can be done in principle (proof: our existence). But there is no proof yet that we ("human intellect") are capable (smart enough) to get it done. There might be a hard barrier to our intellectual capabilities we can't see or didn't hit yet.

[sho]

> There might be a hard barrier to our intellectual capabilities we can't see

I guess? But there's no evidence for that, and you're not even presenting a theory.

[frgtpsswrdlame]

They remind me more of cold fusion.

[sho]

Then you're pretty damn confused. The two are not even remotely comparable.

[frgtpsswrdlame]

I think they're much more similar than AI and flight. We've been promised AI for decades and it's always just around the corner. Yet even today we don't have even simple worm level AGI. We have game-players and cool-picture-makers and maybe some categorization and function-approximators which are useful to business tasks but in general it's a bunch of playthings and fluff.

[sho]

I really think you should examine your way of thinking. I'm sure charlatans have been making and breaking promises about pretty everything you can think of since the beginning of time. It's meaningless and is no basis for estimation.

I am talking about raw scientific possibility, and a good rule of thumb is: if you see it in nature, then it is assuredly possible, and humans will eventually do it a thousand times better.

Cold fusion: Does not exist in nature. Only exists in (controversial) theory. I'll believe it when I see it.

Hot fusion: Exists in nature so it's possible. After developing the technology, humans will be able to do it better. Will take a while.

Flight: Exists in nature, so it's possible. After developing the technology, humans can do it better. Took a while.

Intelligence: Exists in nature (ie you and me). After developing the technology, humans will be able to do it better. Will take a while.

See the pattern?

[calafrax]

> humans will eventually do it a thousand times better.

From an energy conservation perspective nature is perfect. It is impossible for humans to do better than nature when it comes to conserving energy, which is a pretty key problem, so it seems a little optimistic to think that humans can do 1000X better than nature at very many things (or any?).

[sho]

> From an energy conservation perspective nature is perfect

I don't understand. Energy is always conserved no matter if it's nature or humans - literally the first law of thermodynamics. Nature, humans, aliens, anything else is all "perfect" so I don't understand your point, or its relevance

[frgtpsswrdlame]

I might accept that difference with the understanding that if AI is analagous to flight, we're currently at 6th century Chinese kites and not 10 years from Kitty Hawk (which seems to be the perception when the flight analogy is made).

[sho]

Then we are in complete agreement. I am only commenting on the physical possibility. It could very well take a thousand years!