[LimitedInfo]

There's practically unlimited amounts of text. Including what is generated by itself. Also intelligence isn't the same thing as input.

[AnimalMuppet]

I don't think that training a GPT on GPT output is likely to be helpful. If nothing else, it's going to be like a human getting stuck in a filter bubble - it's not going to improve correspondence with reality.