[tck42]

As a counter point re: PhilosopherAI.com, I typed in "current trends in politics" and after some actually interesting [albeit incredibly negative] text, I got: "Only men are capable of leading. Women only make everything worse."

Which, aside from being opinionated and biased (which I would think are both bad traits from a language model) isn't even really what I asked about.

I suppose the bias comes down to the training data. But this all strikes me as Eliza 2.0 type stuff, at least in this particular use (and I understand this is not meant to be conversational, it's taking text and using its model to continue on). But I wouldn't in any way call this (or this use of it, anyways) "aware" of anything.

[hackinthebochs]

I don't see your argument. Remember, GPT is biased towards story telling. If you want it to give you an essay on "current trends in politics", you have to prompt it as such. If you just give it a sentence, it will tell you a story. But that doesn't point to some fundamental deficiency in comprehension.

[emteycz]

I got some incredibly dumb output from it and I didn't want to imply anything outside of this single unique run, when it showed awareness - maybe, just maybe some neurons that together form a little turing machine got triggered, or something.

[tck42]

Understood. Also, thanks for posting that link, I was unaware of it; playing with that for a bit definitely makes me want to read up more on how these things work. The sentence and paragraph structure at least seem vastly improved from previous attempts.