[teruakohatu]

I am amazed mlx-lm/mlx.distributed works that well on prosumer hardware.

I don't think they specified what they were using for networking, but it was probably Thunderbolt/USB4 networking which can reach 40Gbps.