[grey-area]

It really doesn’t see itself, generative AI is not aware.

[Lerc]

Why? Do you have an accurate way to determine if something is aware that could be applied to all possible generative models?

I'm not asserting that they are aware, just asking how you can tell that they are not?

[gls2ro]

Usually the one making a claim has the burden of proof.

So when someone says AI is aware then that someone should demonstrate with arguments that it is true and convince the one saying that it is not the case.

[visarga]

It really does see its past tokens. Attention makes that a core feature, it can introspect on its own past thoughts.

And like humans have to speak one word at a time (serially), so does the model. Distributed activity of neurons funneled through the centralizing bottleneck of serial token prediction. This parallel-to-serial process is the key, I think it's where consciousness is.

[grey-area]

For certain values of introspect.