[ypcx]

The transformer model as presented in GPT-3 may be a few tweaks away from a human-acceptable reasoning, at which point we may realize that human brain is just a neat party trick as well. This may come difficult for some people to internalize, especially those who understand the technology in depth. Because it means that the medium of our reality is the consciousness.

[walleeee]

Was this comment generated by GPT-3?

[Naracion]

I doubted that as well, but I don't think it is--at least it's not a simple copy paste. There's an emphasis on _is_ in the last sentence which I don't think the algorithm could have generated.

However that makes one wonder if it can also learn to generate emphases, and if so, how would it format? With voice generation it can simply change its tonality but with text generation it has to demarcate it in some way--does the human say "format the output for html", for instance?

[sytelus]

You are confusing pattern matching with reasoning. If your brain was replaced by GPT-3 model and you were cast away on a distant island, I highly doubt you will be able to perceive, plan and prosper during your survival against all the calamity nature would through at you.

[mamon]

To be honest, most city-raised humans wouldn't be able to survive on a distant island as well.

[Tarean]

The transformer model in GPT-3 has a short context window and no recurrence. Without some significant architecture changes that is a fundamental limit on the problems GPT-3 can solve.

[lucidrains]

https://arxiv.org/abs/1807.03819

[visarga]

> Because it means that the medium of our reality is the consciousness.

I agree. The environment - as the source of learning and forming concepts, is the key ingredient of consciousness, not the brain.

[yomly]

I don't fully understand what you're getting at here...

Basically the brain and "consciousness" isn't as fancy as we think?

[lucidrains]

Exactly.