[usrusr]

And the sad part is that ai would be a perfect fit for intermittent energy sources: run inference 24/7 (on whatever you can muster, even if it's fossil it simply does not consume all that much compared to training) and over-build training to achieve whatever total throughout you need in time of energy abundance. How heavy would CO2 pricing have to be to make the market do this instead of the exact opposite?

[pjc50]

You can't price out these people, they have seemingly unlimited money.

[JKCalhoun]

Presumably chasing states and localities with generous tax breaks as well. That is no doubt what is really driving the choice of location.

[usrusr]

With unlimited money, you'd be able to do unlimited over-build. At least that's what we thought until recently...

[leonidasrup]

What would be the economy of these data centers if they would run using power source with say, for example 25% capacity factor? What is the capital expenditure of a data center? What is the yearly operational expenditure of a data center?

I found that a 100 MW datacenter can cost roughly $3.35 billion, with a significant portion going to high-end GPUs like the B100 or H100. For electricity, 100 MW data center can incur annual power costs ranging from $41 million to over $131 million, depending on regional energy prices.

[beAbU]

Compute has massive initial capital requirements, and a very short obsolescence window. It does not make sense to invest in compute and then not run it 24/7 at 100%.

Hardware sitting idle waiting for sunshine/wind is leaving money on the table. Especially if you can burn gas during that time and still be hugely profitable.

[usrusr]

Would the world be inherently different if hardware cost was 4x of what it is per unit of training done? The world would be inherently different if we did not burn through fossil stockpiles at the speed we do, or not at all. It's market mechanisms failing to lead to a desirable outcome. Nothing new about that, plenty of problems of that kind have been solved before, but yes, this one is more difficult.

[binary132]

New conspiracy theory: this is all secretly a big bitcoin mining buildout