[emmender]

there is nccl, gpudirect, nvlink and so on and so forth.. It is not just matmul on gpus.