[throw1234567891]

Cool. Apple was the only one who managed to ship a consumer device with UMA and RDMA support. 2TB VRAM max over RDMA.

[vkazanov]

I think the REALLY cool thing about apple's shared memory implementation is the ultra-wide memory bus.

Otherwise, AMD is quite close to what Apple has, and Strix Halo is honestly incredible.

Not sure what RDMA brings to the table.

[throw1234567891]

RDMA increases the inference performance by a significant percentage across devices connected via Thunderbolt 5.4x512 is like a 2TB machine.

[boredatoms]

Thunderbolt RDMA is slower and higher latency than if apple just gave us PCIe, where we could put a (old) connectX card in for infiniband