[wmf]

I don't believe that Stargate is "yesterday's data center". It's being built in multiple phases and Oracle has access to Nvidia's roadmap. They know 200 kW/rack is coming. The newer phases could easily be built out to support Rubin and Feynman.

[HolyLampshade]

200 kW/rack is absolutely insane to me. The power consumption of these facilities is just...ridiculous.

[ineedasername]

With respect to consumption, it’s pretty efficient vs older traditional servers, though I know workloads like that aren’t completely fungible. Nonetheless it bears keeping in mind that a single GB200 NVL72 rack provides 1.4 ExaFLOPS of AI compute (at FP4 precision, ideal circumstances, but this is envelope math all around). So it’s power efficient, for what it is.

[HolyLampshade]

Oh, I have no doubt it is functionally efficient. I'm just amazed given the system deployments I've been party to, and the tiny amount of per rack energy usage comparatively speaking given the functionality of those systems.

Like, what in the good god damn are we using all this energy for?

[bayarearefugee]

> Like, what in the good god damn are we using all this energy for?

Bad AI porn, terrible AI music, AI scams and completely devastating the labor market.

And based on the recent Anthropic/Pentagon rift... I guess also creating autonomous kill-bots and doing mass surveillance.

Just a bunch of super cool stuff.

[speed_spread]

You left out overthrowing governments with customized targeted propaganda, jamming citizen discussion with noise, artificially creating and nourishing contrarian cells in democratic societies. The machines will now be programming people.

[71bw]

>and completely devastating the labor market.

? lol

[Bombthecat]

Since you and me and everyone else will foot the elecricy bill. Energy consumption or efficiency is not a concern.

[dylan604]

It's the water use that concerns me

[speed_spread]

In theory the water stays clean and can be reused. But I assume these cheapskates will go for evaporative cooling everytime? Then yeah, we need laws against that.

[fc417fc802]

I guess when you're dissipating upwards of a gigawatt of power at a single site boiling water starts to look attractive. It's a pretty impressive curveball; I definitely would never have predicted "an evil corporation boils off all the local drinking water" to be a legitimate concern. I'm pretty sure that's too absurd a plot point for even a children's movie.

[Imustaskforhelp]

> an evil corporation boils off all the local drinking water

Nestle jumps into my mind whenever I want to think of an evil corporation and water together.

[carlosft]

I keep hearing people claiming that water is just as much as issue as energy for operating these DCs, but that just doesn't make any sense to me. However, I haven't had to step inside a DC for almost two decades.

[fc417fc802]

Continuously dissipating 1 gigawatt of energy by boiling room temperature water would require approximately 1.38 million liters of water per hour.

Seems like the environmentally responsible thing to do be to build the datacenter near the coast and use the waste heat to desalinate water. Or at least dissipate the heat into the ocean rather than boiling off an inland freshwater supply.

[Rapzid]

Yeah because it's cheaper they go evaporative. That's an easy fix by just making it more expensive.

People talk about the water usage like it's an intrinsic feature of datacenters; it's not. You just make it more expensive so they are forced to conserve. But you wait till you have to so you don't push them to build elsewhere.

[keeda]

This may help you feel better: https://andymasley.substack.com/p/the-ai-water-issue-is-fake

[Aurornis]

The compute power is also ridiculous.

Some of the reason for the high density is that you need devices physically close to each other to share such bandwidth. It’s not because we’re limited by the physical building space, because we can construct buildings all day long. Sending bits around at ultra high speed is hard and you need to keep all of the devices physically close to avoid having your interconnect costs explode.

[HolyLampshade]

Interestingly the realm in which I have domain experience has similar constraints, but based primarily on physical transport latency and less on bandwidth. There has been a move in some spaces towards hyper-dense deployments, but it’s a very small amount of the total compute capacity due to other limitations.

Still, the world I’m used to operating in is typically 5-10 kVA/rack.

[ehnto]

There are box trucks with less power consumption.

[harry8]

So what's the theory that goes with this about why cnbc are reporting that openai are walking because they want newer nvidia hardware? CNBC are clueleess? People at openai are lying to cnbc? cnbc are fabricating stories while drunk?

There has to be some theory to explain the story to be consistent with this comment.

[wmf]

Something is probably happening but I don't know what it is. Maybe this is really a negotiation over price.

[collabs]

I agree with you more than I agree with the parent comment.

To use the hit HBO TV show silicon valley analogy, it is far more likely that "the bear is sticky with honey" will happen at Oracle than at Open AI. Some kind of game of telephone gone wrong at some point and now the people responsible at Oracle must double down in order to kick the can to the next quarter and not appear clueless.

Statutory disclaimer: I am not affiliated with either Open AI or Oracle and have no insider information. All of this is mere conjecture and has no basis in reality.

[cyanydeez]

OpenAI is a unreliable narrator as long as Sam is in charge. Full stop. EM_DASH.

[reilly3000]

Yes and CNBC is comically rife with payola content. I just want to know who’s buying.

[tiahura]

Diedra is a solid reporter with pretty good access and understanding.

[leptons]

>cnbc are fabricating stories while drunk?

Don't forget the possibility that it's AI slop.

[tiahura]

Diedra Bosa is a good journalist.

[TacticalCoder]

> CNBC are clueleess?

That sounds about right.

> People at openai are lying to cnbc?

Remove "to cnbc" and that's a yes.

> cnbc are fabricating stories while drunk?

Maybe not drunk but likely high.