Hacker News new | ask | show | jobs
by eli_gottlieb 4066 days ago
Well I would say that "intelligence" is learning and inference with causal models rather than just predictive or correlative models. You can then cash it all out into a few different branches of cognition, like perception (distinguishing/classifying which available causal models best match the feature data under observation), learning (taking observed feature data and using it to refine causal models for greater accuracy), inference (using causal models to make predictions under counterfactual conditions, which can include planning as a special case), and the occasional act of conceptual refinement/reduction (in which a model is found of how one model can predict the free parameters of another).
1 comments

It's an interesting perspective, but the thing about this kind of definition is that it's very much focused on the mechanism of intelligence rather than the behaviour that the mechanism produces – which flies in the face of our intuition about what intelligence is, I think.

If we found out that one species of chimp learns sign languages through a causal model while another learns it through an associative one (for example) we wouldn't label one more or less intelligent, because it's the end result that matters – don't you think?

Likewise, arguably the ultimate goals of AI are behavioural (machines that can think/solve problems/communicate/create etc.), even if it's been relatively focused on mechanisms lately. Any particular kind of modelling is just a means to that end. Precisely what that end is is still a bit hard to pin down, though.

>Brains are complicated, and there is a huge amount of heterogeneity in how people process information and think about mathematics (and indeed all topics, but it is clearer in mathematics perhaps). Some are very visual, some are big on calculation.

What do you mean by "associative model"? That doesn't map to anything I've heard of in cognitive science, statistics, machine learning, or Good Old-Fashioned AI.

But actually, I would expect different behaviors from an animal that learns language via a purely correlational and discriminative model (like most neural networks) versus a causal model. Causal models compress the empirical data better precisely because they're modelling sparse bones of reality rather than the abundant "meat" of correlated features. You should be able to generalize better and faster with a causal model than with a discriminative, correlative one.

I think I meant correlational, but it was really just a placeholder for "a different model". You could replace the chimp with some kind of alien whose thinking model is completely, well, alien to us – but still proves its intelligence by virtue of having a spaceship.

I'm not necessarily saying that different models lead to exactly the same behaviour. Clearly, chimps' models don't generalise as well as ours do and they don't have a language model that matches ours in capability, for example, which leads to different behaviour. But given that their behaviour is generally thought of as less intelligent as opposed to not intelligent at all, it seems like the mechanism itself is not the important thing.