[nerpderp82]

Nvidia GPUs already support RDMA directly from GPU to Infiniband NIC, bypassing the host completely. 100G is current, 200G is in the works. For lots of GPU workloads that don't rely on lots of little kernel launches, having a completely remote GPU is not out of the question.

If they want to continue building large GPU accelerated workloads, pairing more tightly with networking seems like an obvious move.