Hacker News new | ask | show | jobs
by LawrenceKerr 839 days ago
So would you posit an LLM which self-updates (retrains) its internal model after every prompt-response (perhaps at night, when it dreams of electric sheep) is conscious because it shows some recursive self-reflection & decision making? (And/or add in active inference as described by Karl Friston, whereby it tries to predict outcomes and self-correct its model)

If you knew the LLM does this after every prompt, is that a sufficient condition for possibly concluding that it's conscious? And if this recursion is not enough, what is? What's the missing piece?

>Consciousness doesn't matter. My phone is conscious when its battery is low.

Those are interesting claims...

2 comments

Like I said, "consciousness" is a red herring and doesn't even really exist.

What we care about is whether information complexity is increased. LLMs don't (and can't) do that by the very nature of their mathematics.

What do you mean it's a red herring and doesn't exist?

It's quite literally the only "thing" we can be sure exists, because without consciousness, we wouldn't experience anything at all.

I agree we care mainly about increasing information complexity in AI systems, but we can't discount the possiblity of consciousness being generated non-biologically in the process. I think we just need a better model of what that means exactly.

> ...by the very nature of their mathematics

What are their mathematics? Please enlighten me.

Their mathematics is a statistical model which outputs the statistically most likely result, in effect leaving only the most significant independent variables. Which decreases information complexity, by definition of "information complexity".
So, if I write in, "yes, no" it will output, "maybe?" or will it just do a Google search, or will it just output either "yes" or "no?"

And more importantly, will it give the same response every single time?

> If you knew the LLM does this after every prompt, is that a sufficient condition for possibly concluding that it's conscious?

Yes.

(For me.)