[tstrimple]

Do these large models need the equivalent of SLI to take advantage of multiple GPU? Nvidia removed SLI from consumer cards a few years ago so I’m curious whether it’s even an option these days.

[sterlind]

SLI isn't used at all for CUDA. if you meant NVLink, it's apparently not useful at small scales - I think the PCIe lanes are enough.

[ipsum2]

This is wrong, NVLink is crucial for tensor parallelism in models for training and in large (>40B param) models for inference.