[ben_w]

> All artificial computing systems are limited in ways we are not. Your "Turing Machine" example is one such case. The Halting Problem being a class example.

You appear to be asserting that humans can tell if a loop will end, when that loop is defined so that if it does it doesn't and if it doesn't it does.

> Even my old buck of a goat demonstrates capabilities far, far in excess of anything we have created in all of our computational systems.

How so?

Not saying this is necessarily false — GPT-3 is about as complex as the brain of a rodent, so it wouldn't exactly be surprising even though the LLM only does text and completely different AI do other things — but still, what exactly do goats do that's "far in excess"?

[oldandtired]

> You appear to be asserting that humans can tell if a loop will end, when that loop is defined so that if it does it doesn't and if it doesn't it does

We can determine by looking at certain problems (The Halting Problem is one such example) what the outcome will be without actually having to execute that code. The Halting Problem is one of the simpler problems that cannot be solved by computational means, which includes all artificial computational system.

You ask [How so?] to my comment about my goat. I would suggest that to understand this you need to go and observe what happens in the environment with such beasts, whether it be a cow in a local paddock or a pet dog or cat. Take time to observe the interactions that occur and think about how little [training] is involved here.

Watch children around you, take some serious time and observe them in their interactions and I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.

As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.

I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.

Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?

If you think about it carefully, the task that I describes is incredibly complex.

Now what would be required to get an artificial stupidity system (AS) to do the same task? What programming do we need to do to achieve this task? What programming was done to you to achieve that same task?

When you start asking questions like this, it becomes very clear that all of our computational systems (including all of the AS systems) are incredibly simple and not at all comparable to what we find within ourselves.

We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.

I suppose what concerns me about our current state of affairs is that we are far too impressed by our caveman antics. There is not a single industrial system built by mankind that comes close to the integrated control and manufacturing systems found in a single living cell. None of our communication systems come close to what is found in the various control/communication systems found in even the simplest of chordate organisms.

It was very obvious, 40 odd years ago during my engineering undergraduate days, just how fragile much of our technological base was then. It is far more fragile today and yet we appear to be enamored by our [current technological prowess] which is actually far more fragile than it was 40 years ago.

[ben_w]

> We can determine by looking at certain problems (The Halting Problem is one such example) what the outcome will be without actually having to execute that code.

No, we definitely can't do that in general, and that lack of generality is the halting problem.

> Take time to observe the interactions that occur and think about how little [training] is involved here.

Apart from "all of evolutionary history", (though everyone agrees AI are slow learners when counting how many examples they need if that's your point?), there's continuous feedback from pleasure and pain and probably a lot more emotions that don't necessarily map onto any human qualia.

> I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.

I'd use a different analogy; dinosaur perhaps.

> As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.

I think my Roomba-clone does that: touch an obstacle, back off, rotate a few degrees, go forward again.

Now that, I'm fairly sure was programmed rather than learned (in the robot; still learned in the bacteria via evolution).

> I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.

> Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?

How: a network of neurons, if I remember right about 40 deep, integrating mostly proprioceptor input as it's continuously updated when my muscles move.

When: unclear, either as an infant before and autobiographical memories, or genetic (which is arguably "not me").

I'm not sure this matters, either way though, as we do have robots which are navigating entirely by proprioception, and which again learned by training rather than being programmed.

> What programming do we need to do to achieve this task?

basically:

""" from FooLibrary import AiModel

model = AiModel()

model.learn(input, expected_output) """

With a lot of optional parameters in the constructor for different hyperparameters like "learning rate" and neurons/layers…

> We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.

When tools stops being mere tools — regards of this is mere perception, or when peasants and slaves revolt, or when (Australia) pest-control animals themselves become pests — we generally have big problems.

I agree the world is more fragile; I don't know if AI will help or not.