We can't, indeed, but if the past is any prediction -- it will have a few good iterations, better features each time, smaller models, but it will quiet down after a few iterations.
Unless Open Ai found some completely novel way of training GPT to enable the exponential growth in training data required up until now.
Unless Open Ai found some completely novel way of training GPT to enable the exponential growth in training data required up until now.