|
|
|
|
|
by bluedino
643 days ago
|
|
Take your typical 'GPU node', which would be a Dell/HP/SuperMicro with 4-8 NVIDIA H100's and a single top high level AMD/Intel CPU. You would need 2-4 240v outlets (30A). In the real world you would plug them into a PDU such as: https://www.apc.com/us/en/product/AP9571A/rack-pdu-basic-1u-... Each GPU will take around 700W and then you have the rest of the system to power, so depending on CPU/RAM/storage... And then you need to cool it! |
|
Cooling is its own story... Man, figuring out this process was hella of a journey