|
|
|
|
|
|
by kkielhofner
1034 days ago
|
|
|
With Nvidia this is (typically) setting the power limit[0]. Even with the default power limits of my RTX 4090s (480 watts)I don't think I've ever seen an ML workload get close to that and as the referenced article demonstrates you can more-or-less set your power limit to somewhere around 75% of max without losing much if any performance depending on workload. It doesn't take much testing to come up with the ideal power limit for your given workload(s). [0] - https://www.pugetsystems.com/labs/hpc/nvidia-gpu-power-limit... |
|
|