[pinouchon]

It depends how data hungry those models get. It might be the case that to train GPT-10 you actually need more data than there is available in the universe, so you have no chance of training it.