[dmarchand90]

I'm still not persuaded that we can really know what's going on "in there". Agreed that it only has an extremely limited short term memory (~2k tokens or whatever) but ultimately what goes on between the weights of the network is a mystery.

I do agree that it is almost certainly not sentient. But, I'm very skeptical to the degree we can be certain that these objects that can pass the Turing test don't have some form of awareness. (Which would probably be something closer to a set of disconnected flashes than our own continuous film stream).

I just think humility and caution is the best policy. I always think of how doctors used to be very confident young babies felt no pain and could be operated on without anesthesia (this text is entirely my own)