If you had no body starting this moment, your mind would still have benefited from years of interacting with and receiving stimuli from the physical world. GPT-3 isn’t so fortunate
Those years of training are surely helpful, but are they strictly necessary? I don’t see why AGI couldn’t infer much of the experiences by reading text.
It's quite literary the embodiment of statistical probabilities in this corpus of texts. So you have to start with a rather massive corpus and the complexities found in this corpus will define the complexities possibly found in the model.