|
|
|
|
|
|
by colingauvin
3 hours ago
|
|
|
The problem is you'd have to traverse the PCI-E bus every transfer. Even with DMA it still has to physically get off the drive and onto the card. Even with the mythical PCI-E 6, if you had enough NVMEs to saturate, you have to do two transfers to get it to the inference hardware. And that tops out at 128 GB/s which is roughly the speed of DDR5 but with one extra hop. Optane would actually be useful in this era. Intel was ahead of their time. |
|
|