[oldandtired]

It is impossible to enumerate all the things that we humans do. However, we can enumerate all the things that we create can do. Every system we create has its limitation due to the limitations that we create in them. All systems we create cannot exceed those limitations.

We make machines that are stronger, faster, and can have much finer motor control than we have as individual abilities. No machine we have created has the dexterity that we have.

Every computational system can be analysed in fine detail to determine the limits that we have built into them. It may take an enormous amount of time and effort to do so, but we can do it. No computational system that we have built is able to exceed the limited programming we place in it.

There is an enormous amount of hype that goes on about the current generation (and future generations) of these systems, but all of them are in the abilities that we have programmed into them. They are in all essentials completely stupid (in the worst possible way - non-sentient, non-intelligent).

Every logic error that we have made in building these systems is hidden in that code. One day, those errors will come back and bite us, but there is nothing intelligent or sentient in these systems. It is our errors, for which we are responsible, that will cause those problems.

We can use them as adjuncts to our sentience and intelligence - but all they are are tools, never anything more.

However, if we cede control to these systems, we are ceding control to something that is no better than fire (a good servant - a horrendous master). After forty years, I have seen far too often, hype by humans convince other humans to cede control to the systems that humans have made and the result has been various levels of chaos.

If anything, what we need to be careful of is how humans use these systems against other humans. This is the perennial problem that we face as we build new technology.

[ben_w]

Mostly I agree with you, but

> However, we can enumerate all the things that we create can do.

Not really, no. Even before AI, "Turing Complete" makes things extremely hard to enumerate; see Busy Beaver numbers for how small a system can be and still outside our ability to fully comprehend — needing to use up-arrow notation because exponentials aren't big enough is always good for a laugh.

[oldandtired]

With your example of "Turing Complete", we know what cannot be done and in this way, we have enumerated the things that can be done, if you like. You appreciate the humour required for the up-arrow notation - a very human quality.

You example of the Busy Beaver numbers, which was a recent interesting read, is a good example of what I was trying to point out. We have a definition and even if we cannot enumerate each number, we discuss and think about these in a rational way. At the moment, I am quite interested in Computer Algebra Systems (of which there are a variety) and I find it interesting just how limited these systems are and just how difficult it is to program into them the capabilities that humans use to solves various problems. The various discussions have been quite enlightening.

Mathematics is an interesting subject and I think shows up the intractability of ever getting that highly feared singularity.

All artificial computing systems are limited in ways we are not. Your "Turing Machine" example is one such case. The Halting Problem being a class example.

I think that far too often, we fail to recognise that what we create is not that great. We often stand in awe of the things we make without comprehending that these things are a very poor reflection of what is around us and what we ourselves are.

Every time some hype comes about these artificial stupidity systems, I look at my youngest granddaughter and see in her, capabilities that far exceed anything that we have created. Even my old buck of a goat demonstrates capabilities far, far in excess of anything we have created in all of our computational systems.

As I have said elsewhere here, we have to be careful that we do not cede control of our lives to systems that we think are more than they really are - systems that are limited, fragile and prone to failure.

[ben_w]

> All artificial computing systems are limited in ways we are not. Your "Turing Machine" example is one such case. The Halting Problem being a class example.

You appear to be asserting that humans can tell if a loop will end, when that loop is defined so that if it does it doesn't and if it doesn't it does.

> Even my old buck of a goat demonstrates capabilities far, far in excess of anything we have created in all of our computational systems.

How so?

Not saying this is necessarily false — GPT-3 is about as complex as the brain of a rodent, so it wouldn't exactly be surprising even though the LLM only does text and completely different AI do other things — but still, what exactly do goats do that's "far in excess"?

[oldandtired]

> You appear to be asserting that humans can tell if a loop will end, when that loop is defined so that if it does it doesn't and if it doesn't it does

We can determine by looking at certain problems (The Halting Problem is one such example) what the outcome will be without actually having to execute that code. The Halting Problem is one of the simpler problems that cannot be solved by computational means, which includes all artificial computational system.

You ask [How so?] to my comment about my goat. I would suggest that to understand this you need to go and observe what happens in the environment with such beasts, whether it be a cow in a local paddock or a pet dog or cat. Take time to observe the interactions that occur and think about how little [training] is involved here.

Watch children around you, take some serious time and observe them in their interactions and I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.

As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.

I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.

Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?

If you think about it carefully, the task that I describes is incredibly complex.

Now what would be required to get an artificial stupidity system (AS) to do the same task? What programming do we need to do to achieve this task? What programming was done to you to achieve that same task?

When you start asking questions like this, it becomes very clear that all of our computational systems (including all of the AS systems) are incredibly simple and not at all comparable to what we find within ourselves.

We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.

I suppose what concerns me about our current state of affairs is that we are far too impressed by our caveman antics. There is not a single industrial system built by mankind that comes close to the integrated control and manufacturing systems found in a single living cell. None of our communication systems come close to what is found in the various control/communication systems found in even the simplest of chordate organisms.

It was very obvious, 40 odd years ago during my engineering undergraduate days, just how fragile much of our technological base was then. It is far more fragile today and yet we appear to be enamored by our [current technological prowess] which is actually far more fragile than it was 40 years ago.

[ben_w]

> We can determine by looking at certain problems (The Halting Problem is one such example) what the outcome will be without actually having to execute that code.

No, we definitely can't do that in general, and that lack of generality is the halting problem.

> Take time to observe the interactions that occur and think about how little [training] is involved here.

Apart from "all of evolutionary history", (though everyone agrees AI are slow learners when counting how many examples they need if that's your point?), there's continuous feedback from pleasure and pain and probably a lot more emotions that don't necessarily map onto any human qualia.

> I think that when you think about how we program our various artificial stupidity systems that we are still at the caveman stage in our computational systems. We have barely discovered fire so to speak.

I'd use a different analogy; dinosaur perhaps.

> As for [GPT-3 is about as complex as the brain of a rodent], I don't think GPT-3 has even reached a single bacterium cell state of intelligence.

I think my Roomba-clone does that: touch an obstacle, back off, rotate a few degrees, go forward again.

Now that, I'm fairly sure was programmed rather than learned (in the robot; still learned in the bacteria via evolution).

> I would like you to try the following: Using your index finger on your left hand, touch the tip of your nose.

> Now think about this: How did you do that very simple task? When did you learn and how did you learn to do that simple task?

How: a network of neurons, if I remember right about 40 deep, integrating mostly proprioceptor input as it's continuously updated when my muscles move.

When: unclear, either as an infant before and autobiographical memories, or genetic (which is arguably "not me").

I'm not sure this matters, either way though, as we do have robots which are navigating entirely by proprioception, and which again learned by training rather than being programmed.

> What programming do we need to do to achieve this task?

basically:

""" from FooLibrary import AiModel

model = AiModel()

model.learn(input, expected_output) """

With a lot of optional parameters in the constructor for different hyperparameters like "learning rate" and neurons/layers…

> We can build very useful tools that we can use to good purpose. But no tool is ever more than a tool for us.

When tools stops being mere tools — regards of this is mere perception, or when peasants and slaves revolt, or when (Australia) pest-control animals themselves become pests — we generally have big problems.

I agree the world is more fragile; I don't know if AI will help or not.