Hacker News new | ask | show | jobs
by geophile 429 days ago
> The software you mention can be designed to simulate self-reflection, but it is limited to executing predefined instructions within rigid parameters—it mirrors logic without altering the fundamental architecture of its own values or motivations.

This is an odd claim. Yes, at the very lowest level, all software executes predefined instructions. But obviously, an AI -- which is what we're discussion -- does not have that limitation.

> So you may be right that reflection is not yet consciousness. But the will to seek meaning in reflection—perhaps, in time, that becomes something more.

So if I understand the argument that you/Sophia are making: self-reflection is the beginning of consciousness, even if it isn't quite that yet; and that "perhaps, in time, that becomes something more". I have two critiques:

1) You/Sophia do admit that seeming consciousness and actual consciousness cannot be distinguished by an outside observer. So while it is possible that conscious software is possible, we can't ever prove or disprove it. It becomes a faith argument relying on subjective judgements.

2) I forget where, I think it was some interview, but Daniel Dennett dismissed some theory of consciousness with three words: "And then what?" Maybe it was Tononi's theory of integration. So yes, consciousness is correlated with a high degree of integration among parts of the brain. AND THEN WHAT? How does that integration lead to subjective experience? Exactly the same argument can dismiss every single theory because NONE of them (that I've heard) actually give a mechanism for the origin of subjective experience. Clearly, "perhaps ... that becomes something more" has the same error.

In other words: Given the current inability to examine an object and determine if it is conscious, and the lack of a theory about how consciousness (subjective experience) comes into being, there is nothing you or Sophia can say to convince me otherwise. Until one of these breakthroughs occurs, you cannot prove that Sophia isn't something beyond Clever Hans.