[Maursault]

> The “mind as software” meme really needs to have better evidence

It never will because it is fundamentally a bad metaphor in reverse. The proper metaphor doesn't apply in reverse to mind and brain. Mind is not an algorithm or a series of instructions that gets executed on brain, the notion is absurd.

Mind is also not something else, it is not some thing, as it has no substance, has no weight, color, smell, etc. Though we are certain the brain is the seat of the mind, you can slice up brain as many ways as possible and never find the mind. Near as experts can figure, mind is a phenomenon of personal experience that arises from healthy brain.

Conversely, Strong AI, a living but artificial mind in a digital machine, is unattainable and will remain the domain of science fiction, though it is easy enough to have a convincing enough AI fool us into believing an AI has personal experience, it is simply physically and logically impossible, at least until two things occur: 1) we actually fully understand mind (unlikely to occur) and 2) we attain the ability to create neurons at the scale of what makes neurons (may be impossible). But if it ever occurs, what a horrendous and cruel thing to create. Imagine being consciousness under those conditions.

[nzmsv]

But what about Plato's cave? You say that a mind arises from a healthy brain, but let's say we put a perfectly healthy brain into an environment where it cannot experience the same kind of stimuli that the brains riding in our bodies do. Would it still be healthy? Could we relate to this intelligence, and would we consider it to have a mind?

I'm no expert, but I wonder just how much of the distinction is entirely artificial and the only fundamental difference between our intelligence and what we call AI is the set of input data, and the rest of the difference can be attributed to scale. After all, scale has an effect on cell-based wetware too. Does a cat have a mind? Could one pass for a human?