|
|
|
|
|
|
by guitarlimeo
636 days ago
|
|
|
> It's plainly obvious when you run even the very modest AI models at home how much power these things take. Really good point to put this into perspective. I tried models locally and my gpu was running red hot. Granted, I think the server boards like H100 are more optimized for the AI workloads so they run more efficiently than consumer gpus, but I don't believe they are more than 1 magnitude more efficient. |
|
|