[tiagod]

Every token emitted is a full-pass through the network, with the prompts and previous tokens (sent by you and the AI) given as input.

And I agree that there is certainly a capacity for reasoning, no matter how flawed it is. There is plenty of evidence of AI solving novel problems 0-shot. Maybe not 100% of the time, but even if you have to run it 100 times and it gets it right 75% of the time in pure reasoning problems, it's doing better than randomness.

[tombert]

I completely agree. I'm not philosophically-brained enough to know how to define "intelligence", but I do think that ChatGPT qualifies as at least "intelligence-lite".