[semi-extrinsic]

>Bottleneck was memory transfer bandwidth across PCI-E

This is why Nvidia are working on NVLink to replace PCI-E.