[CommieBobDole]

I think the strongest argument against AI consciousness is that there's no persistent internal state, no feedback, and no change; the 'conversation' you're having is a series of one-off API calls where each subsequent call is provided enough information about the previous calls for it to generate a plausible response.

If we (very, very generously) assume that an LLM is a structure capable of conscious thought, then it's still not conscious - we've created a representation of a brain which we turn on for a fraction of a second to generate text and then return it to the representative state. There's no opportunity to develop consciousness, it's a brain trapped in stasis.