[Iwan-Zotow]

So, how new knowledge would be created?

GPT has no reasoning capability. So, as time goes on, information massive(s) will be filled with GPT-X made up answers. It means GPT-X+1 will be trained on GPT-X generated data. So, without reasoning, how this thing will work in perspective?

[criddell]

I wouldn't assume that future versions are going to work the same way past versions did.

[Iwan-Zotow]

MAybe, maybe not.

Problem is with data/content creation. If all new data are created with GPT-3, how it will help GPT-4?

No new original content -> no new model