But I assume the SoC or the processor itself does have PCIe expansion ports, right? Internal GPUs should in theory work should the part be sold by itself.
Unless Apple starts selling some overpriced PCIe devices, don't hold your hopes up on this. Ram is soldered / integrated into the SoC. Tomorrow even the SSD will be (if it isn't already). Ultimately you will not be able to upgrade anything, just like your iPhone or iPad.
Apple Silicon has not yet been made available in a Mac Pro enclosure (where PCIe internal GPUs could be used). We can only guess what the story will be when it is, as no statement has been made by Apple either way.