[sterlind]

SLI isn't used at all for CUDA. if you meant NVLink, it's apparently not useful at small scales - I think the PCIe lanes are enough.

[ipsum2]

This is wrong, NVLink is crucial for tensor parallelism in models for training and in large (>40B param) models for inference.