[beoberha]

I know enough about how neural nets work to be absolutely blown away at how good the GPT are. I only skimmed the paper, but even chatGPT showed a lot of these “sparks”, IMO. We are certainly a long way off from any semblance of general intelligence, but for a model that just tries to predict the next word, I’m dumbfounded at how good it is.

[otabdeveloper4]

Maybe the words we write aren't as smart as we think.

I mean, The Akinator can read your thoughts and that thing hasn't even graduated to a neural network from "a bunch of if/then statements".

[crooked-v]

> We are certainly a long way off from any semblance of general intelligence

Part of me is starting to think that the only thing we're really missing at this point to start seeing that is to have one of these models that can modify itself with its output and thereby have a mechanism to 'learn' or 'remember' things.

[shivekkhurana]

"Long" might not be a long time as humans perceive it.

Human perception of time is linear. That doesn't apply to LLMs.