|
|
|
|
|
by mr_toad
590 days ago
|
|
> CPU trying to read or write that same memory will be limited by the PCIe bus, which is glacially slow by comparison, usually somewhere around 16-32GB/sec. If you’re forking out for H100’s you’ll usually be putting them on a bus with much higher throughput, 200GB/s or more. |
|