[redleader55]

Nvidia doesn't only produce GPUs. They have their hands in all sorts of interesting technologies from high speed, performance NICs to switches. The GPUs in the data centers don't just function as an individual unit, but they are able to use the "backend" NICs of the server, in conjunction with their proprietary NCCL library to send data with as close as possible to "zero-copy" from GPU to GPU with very good horizontal scalability. As you can imagine the network fabric behind this is quite important, and Nvidia having one the best Infiniband switches helps keep this monoploy.

There are many companies working on alternatives at the moment, but it will be a while until Nvidia can be replaced.