|
|
|
|
|
|
by throwa356262
2 hours ago
|
|
|
Did you see this section? To the B200’s defence, its numbers are somewhat deflated by the fact that it pays a cross-node all-reduce on the decode critical path (RoCE v2 at ~195 Gb/s) — it’s the only config here that spans two nodes
|
|
|