[visionscaper]

Like others mentioned in this thread, I don't think this is Apple's final vision for a Apple Silicon Mac Pro. To me, the only way forward is for Apple to, either use PCIe, or another proprietary high bandwidth bus solution, to connect together multiple Apple Silicon boards. This would result in a Mac Pro in which you can slide in multiple Apple Silicon modules, i.e. Mx Ultra modules.

For distributed Machine Learning workloads it also make sense to combine a CPU and a GPU per pluggable module. In such workloads, data that needs to be processed by a specific GPU (i.e. for training), is usually preprocessed by a CPU. In Intel machines with multiple Nvidia cards, this implies that you need a single beefy CPU with high core count. Having a CPU and GPU in each module makes sense from this perspective.