Hacker News new | ask | show | jobs
by zefei 4230 days ago
To say something is pseudo-intelligence or true intelligence, one has to define intelligence rigorously. That is more philosophical than people think, because how little we scientifically understand about intelligence, or consciousness, or even life.

For most of people, the intuition of intelligence is a bit naive, and nowadays intuition is often at the opposite of the truth. It often is along the line of "looking intelligent and knowing what it is doing”. Something like turing test describes the first part intuitively. But we soon found out that we wouldn’t call something “intelligent” even it passes turing test since the machine is unlikely to know why it is saying something, hence the latter part. But again, this is about consciousness or “strong AI”, which is even further away from our understanding than “intelligence”. How do we know that the machines that “look intelligent” don’t “know what they are doing”? Consciousness is very hard to define and even harder to inspect, and maybe someday machines begin to have consciousness even before we realize it? In fact, we already did this to most animals, thinking they are not intelligent or self-conscious while they are.

But to me, the psychology behind these definitions is very interesting and maybe quite important. No matter how we try to define intelligence, we wouldn’t call machines intelligent until they very much behave like us. Because to most people, intelligence is what defines humans, so they intuitively use their feelings of “does that feel human” to benchmark intelligence. And psychologically, we are exceptionally good at telling something “not human” from “feeling/looking/speaking like human”. But this is a very narrow and, if I dare to say, ignorant and self-centric view, because it implicitly relies on the thinking of “we are far more intelligent than any other life form, and human's intelligence is the only way intelligence can be work”.

Think about it, if there’s a super-intelligent being that observes our world, maybe to it, human’s intelligence is as primitive as fish, and trees aren’t far behind; and maybe, entities such like countries or the internet are actually of more intelligent “life” forms, just we haven’t realized that yet because they don’t look like us at all; and maybe, on the scale of intelligence from 0 to that super-intelligent, humans, birds and machines are clustered in a small range, though significantly larger than zero, still not far from it.

Although the research on human brains and a lot of our own stuff inspired the research of AI quite a lot, it is perfectly possible that we create something truly intelligent or conscious without us understanding human intelligence or consciousness fully. We can have a different kind of “intelligence”, and our researches are well on their way toward that. It’s very hard to see because we don’t understand intelligence, and maybe our hardware isn’t powerful enough to fully utilize our theories.

3 comments

But this is a very narrow and, if I dare to say, ignorant and self-centric view, because it implicitly relies on the thinking of “we are far more intelligent than any other life form, and human's intelligence is the only way intelligence can be work”.

I would rephrase that last bit as "human intelligence is the only way intelligence has been proven to work." We just don't and can't know which bits of human intelligence are necessary and which are arbitrary. For example, an emotional framework, the aspect of having drives and "desires" that lead to "illogical" and "irrational" behavior and interactions with others - is that required or not? How can we begin to reason about a non-human-centric concept of intelligence? Given how little we understand, I think that is too tall a task at this point.

and maybe, entities such like countries or the internet are actually of more intelligent “life” forms, just we haven’t realized that yet because they don’t look like us at all

I do believe that the collective aspect of intelligence has been wrongly ignored in AI. We try to build these monolithic beasts that take in mounds of information and try to make sense of it all themselves. But (yes, relying again upon the only known implementation) a single human on its own will never achieve the modern sense of intelligent behavior. It needs a society of humans, the benefit of a shared amorphous corpus of understanding that exists outside of any individual. And it requires many independent individuals with their own perspectives and ideas to probe and extend the boundaries of that understanding.

While I agree with your point that intelligence must be defined rigorously. We don't need to leave it to the philosophers. After categorizing the types of definitions, Shane Legg successfully used "Property of an agent that interacts with its environment so as to successfully achieve goals across a wide range of environments"[1] for his work in AI.

What Alva Noë is hinting at is the flaw with weak or pseudo-intelligence, as Alva calls it. As impressive as deep blue is with chess, or Watson with Jeopardy, they fail the "goals across a wide range of environments" test. This is clear with deep blue, and Watson once you realize it's just a glorified search engine.

I often hear people claim Watson learns because it improves based on the answer in the category. While it does use previous answers to tweak the final ranking algorithm. All of this is lost once the category is finished. To really "teach" Watson, you need to add more data to its index and re-index offline.

We have a workable definition of intelligence. What we're missing is a fundamental primitive unit of strong AI. Until this is found, AI will always remain just a bag of tricks, only capable of solving problems its programmers planner for.

[1] https://www.youtube.com/watch?v=V6umr1OP8uo

There's still a huge dearth of rigor in defining both the width of a range of environments, the degree of success in achieving goals, and the significance of various goals. I'll expound briefly on the first. Who is to say that the range of "environments" a chess supercomputer faces is narrower than the environments a human faces? Obviously, we intuit our range of environments to be wider, but can we explain why rigorously?
It's more than intuition. Both chess and jeopardy are subsets of the human environment. Watson couldn't handle tic-tac-toe, never-mind chess. Change one rule of chess, and human could cope but Deep Blue would need to be rewritten.
> How do we know that the machines that “look intelligent” don’t “know what they are doing”?

And, equivalently but perhaps more philosophically evocative, how does one know that other humans "know what they are doing"?