Hacker News new | ask | show | jobs
by robotnikman 219 days ago
We still need to fix the problem with powering these Datacenters....
4 comments

> We still need to fix the problem with powering these Datacenters....

Not really. We need to insulate consumers from the market that is solving and will solve that problem. That's a financial engineering and policy problem. America is good at the first. We're bad at the second. That implies state and local initiatives should take the lead.

My proposal: one market for essential residential consumption, defined as the median household consumption per region [1]. (If you don't use your allocation, you should earn a rebate.) Above that, market price. Same for preferred commercial uses, e.g. retail and local government.

[1] https://www.eia.gov/energyexplained/use-of-energy/electricit...

There should be a tenure element to power access. The reductio is a well-funded adversary should not be able to buy all the power in a region just because they are able to pay more.

Our utilities are generally regulated, and have some mandate to provide power to residents. If a datacenter creates a sudden dislocation in the demand for power that causes massive unplanned CapEx by the utility, what is the argument in favor of longtime residents having to pay for that CapEx?

> There should be a tenure element to power access

We have a tenure-based system for water rights in the Western US, and it's not without its problems. See, e.g., https://www.globalwaterforum.org/2022/11/03/the-paradox-of-u...

> should be a tenure element to power access

What does this mean?

> what is the argument in favor of longtime residents having to pay for that CapEx?

Jobs and tax base. These benefit the middle class more than the poor, hence my redistribution proposal.

Data centers notoriously do not bring much in the way of either jobs or tax base.

Meta's planned gigawatt-scale DC in Louisiana is projected to create ~500 jobs. If energy prices for the state increase by only 20%, that does not feel like something the people of the region would obviously want to do if given the choice.

I don't understand why the energy rates for residents should go up at all? Why isn't the data center paying for it? Even my personal bill gets more expensive per kwh the more I use, shouldn't a data center using exponentially more power just pay a higher per kwh rate, honestly to the point that they are making it cheaper for normal customers??
> shouldn't a data center using exponentially more power just pay a higher per kwh rate

Power law pricing is a good idea.

> If energy prices for the state increase by only 20%

Are there forecasts energy prices will increase 20% long term?

Georgia, where data center construction has been booming, has seen rate increases significantly higher than this. IIRC there have been 6 rate increases in the last 2 years, with a 24% increase in 2024 alone.

I don't believe any of this was part of the forecast of 10 years ago, so I would not trust a long-term forecast issued now.

> There should be a tenure element to power access.

NIMBYism, but applied to grid power!

I actually think we should have more power plants, and we should generate a lot more power.

At the same time, it is not obvious that utility systems in communities are equipped to respond well to actors who are 1) not local 2) high growth 3) demand rapid deployment 4) are willing to spend flagrantly to move fast.

Put another way: should OpenAI be allowed to pay (say) 10x the going rate[1] for electricity in a region in exchange for being given the right to consume 90% of the electricity generated in that region? What principles should govern this balance and the acceptable price changes? How do those principles extend to determining who should cover CapEx for expansion? Does Texas need the 57 permanent jobs in Abilene that Stargate will generate so badly that millions of Texans should subsidize the richest startup ever?

1 - this is a hypothetical, but OpenAI's Stargate project in Texas is projected to cost multiples of the total assets of any of the large multi-state power generators in the country. None of the utilities are setup to engage with a buyer like that.

> what is the argument in favor of longtime residents having to pay for that CapEx?

The argument is that people like air conditioning and lights, so they will pay, or leave.

If the existing power supply is sufficient to supply the A/C and lights for an area, but a new buyer comes in and offers 10% more $ to purchase all the power currently being generated, there exist also the options of 1) make the new customer pay a lot more to deliver power quickly or 2) simply deny the connection rights (presumably much easier to do when talking about gigawatt-scale requests).
> That implies state and local initiatives should take the lead

You are right... but GOD help us if state and local initiatives take the lead...

This announcement isn't just for the construction companies; it's for the power companies.. Anthropic is basically saying we're going to build a factory the size of a nuclear plant here. If you start building it now, you'll have a guaranteed buyer in 5 years
Super large DC's yes. However, there is tons of what I call stranded power. Only need 1-2MW? Well, that's $30-100M worth of compute capex, but it really isn't hard to find power / space for that.
the administration is allowing datacenters to be utilities and build their own power plants, nuclear or otherwise.

the excess can be sold to the grid.

it's really the only way forward. seems like a win/win.

Even better, don’t just “allow”, but force them to create power plants equal in size to their usage. Must be renewable.
I don't care what they use. Nuclear preferred but whatever works for the area.

Natural gas is the main reason our emissions have gone down as it replaces coal.

Also I don't think forcing is necessary. These datacenters want to, why impose more regulations.

Your grandchildren will care if they use coal or natural gas.

Aim higher. Do better.

Yes they will, they will prefer natural gas of those two. The main reason of emission reductions as we transition off of coal.

I really hope we go all in on nuclear though, with some natural gas and get rid of the windmills. Solar, hydro, geothermal can stay where it makes sense.

Unfortunately our skies and land are littered with windmills made out of unrecyclable polymers that are terrible for raptors.

Queue someone quoting how many cats kill birds like competing with the top predator is a good thing, or ignoring the fact that we put these in raptors' wind streams and cats don't hunt those large birds (which are usually endangered)

Our kids deserve nuclear.

Aah a True Bird Lover. Wants to protect birds from windmills. Doesn't care how many bird habitats oil drilling destroys. Hasn't seen any pictures of oil coated birds from the Exxon Valdez or the Deepwater Horizon.

> made out of unrecyclable polymers

Does this mean you support banning plastic straws too? All plastics are essentially unrecyclable.

> Our kids deserve nuclear.

By all means. If it can be done as cheaply as wind and solar.

> Unfortunately our skies and land are littered with windmills made out of unrecyclable polymers that are terrible for raptors.

Like our lands and oceans are not littered with drilling platforms and fracking stations already

> it's really the only way forward. seems like a win/win.

There is another way forward, which is not building these data centers, forcing AI companies to use power more efficiently, and use the excess energy production capacity towards the energy transition in order to avoid the worst consequences of climate change.

It's not going to happen, at least not right now, but it's clearly what we ought to do. ChatGPT can wait.

> forcing AI companies to use power more efficiently

How? Also, why? Why are datacentres the use to tamp down on versus other industrial and commercial uses?

This reminds me of California rationing residential water use so alfalfa farmers can flood their fields.

All good questions, I don't claim to have all the answers. What I'm saying is that using gigawatts of power for "AI" in this day and age is madness.

I do like the market insulation idea you propose in another comment (I would link to it, but apparently HN doesn't allow that).

> What I'm saying is that using gigawatts of power for "AI" in this day and age is madness

Why? American datacentres--of all types--use about 250 TWh per year, with another 500 TWh additional capacity expected by 2030 [1]. American paper manufacturing used about that much energy in 2018 [2].

[1] https://www.iea.org/reports/energy-and-ai/energy-demand-from...

[2] https://www.eia.gov/energyexplained/use-of-energy/industry.p... 2,491tn BTUs ~ 730 TWh

If I read the data right (1) the US currently produces roughly 4,000 TWh of electricity every year. 500 TWh is a significant portion of that! The US will need a lot of additional capacity for things like electric cars and heat pumps. Most of the effort should be going towards that, not huge data centers attending to unproven demand (how many people will pay the real price for ChatGPT once the VC subsidy ends remains to be proven).

1: https://www.ceicdata.com/en/indicator/united-states/electric...

Yes but American datacenters and industries are actually useful compared to AI.
Why should they be treated differently than any other customer?
If they are treated like every other customer, all of our energy bills go up the more data centers they build

This is not a theoretical concern, it is happening already.

https://www.youtube.com/watch?v=YN6BEUA4jNU

OK then I guess we should disconnect every large industrial electricity customer from the grid. That way we'll all have lower energy bills, right?
> OK then I guess we should disconnect every large industrial electricity customer from the grid.

No, what we should do is put every "large load" electricity customer (including but not limited to these data centers) into their own rate-payer class like they did in Maryland and Oregon instead of lumping them in with everyone else.

Once they are in their own rate-payer class then their rates can be adjusted to pay for the costs of the increased infrastructure that is only needed because they exist (take away data center build-outs and electricity usage is largely flat or falling pretty much everywhere in the US).

I hope the data center developers are paying you to lobby for their ongoing corporate welfare? Because that's what you're basically doing here.

(I don't know the answer to this,) is it common for a single customer to enters a market with an ask for 10GW to start?
Because we live on a finite planet and unregulated capitalism won't end well.
I think you may be missing the whole national security part of the AI race. This isn't just about asking a computer what recipe you can cook tonight with the items in your fridge. In many ways it is similar to the race to build a nuclear bomb. We may individually not like that, but we might individually be best served to live in the nation that got there first.
We can see in Ukraine that AI plays a very very small role in the war. Production of small drones and their control across jammed areas is the current problem space.
And I bet that a majority of those LLM usage in Ukraine is via local focused models, good for picking shapes on a grainy images and not much else, but fast and cheap. There is literally zero use for the gigantic general LLMs which can produce human-like output and routinely generate fake numbers, in the army setting.
Building gigantic data centers doesn't help in that respect. The data centers are there to do inference at scale, not cutting edge research.
That's the story the proponents of the AI bubble would have you believe, because they are sucking in all available funding to their enrichment, or because they've been huffing their own hype gas for so long that they have no brain cells of their own left.

It is, however, complete nonsense, and the next few years of failed promises on AGI will eventually bring people to their senses, if a market crash and sustained economic depression doesn't do that first. It would be funny if it wasn't going to cause suffering for millions of people, whether we succeed at AGI or not.

I _like_ AI, I find LLMs and many other aspects of useful, and I am optimistic for the long term prospects of AI. But the rush to try and get to AGI is completely out of control at this point, and the fallout from when the bubble pops will set AI, and our societies, back a long time.

Colocated power might be more efficient, depending on how it's done. It avoids transmission losses and allows the grid to be used for other purposes.
That's not a way forward, that's standing still.

I'm all for more efficient usage, and it's in AI companies best interest to do so to minimize costs.

...but it's a growing industry, it will need more power.

No, it's not standing still. It's setting the priorities straight.

Completing the energy transition is an enormous undertaking. Building huge data centers is a distraction, not a way forward.

"Allowing" doesn't necessarily translate into "doing". Many people are seeing higher energy prices which are at least in part or wholly due to data center loads on local power grids. In Ohio, for example, we just skated by with a ruling from our Public Utilities Commission which effectively required data centers to pay for their impact on local grids [1].

Additionally, while these data centers do provide some jobs, where states are giving them grants, loans, infrastructure improvement, or otherwise they are ultimately extractive developments (like parking lots) where the wealth flows out from states like Ohio and flows in to states where the CEOs and HQ sit (California, New York, etc.).

I can tell you that people in Ohio across the political spectrum are not happy. We are losing good farm land, utilizing water, and our power costs are going up for negligible benefits at best. But hey now our state representatives can say "Meta is coming to central Ohio". Meanwhile costs are going up and we still have to ship produce in from other countries and states.

If our representatives and governors office thought about this all for about 2 seconds they would require any data center development to include 2x the number of corporate jobs over a certain income threshold or else not approve the development. If the developers balk, then fine it's not like we want them anyway.

The Trump Administration (and for that matter probably any admin) isn't doing jack shit.

[1] https://www.news5cleveland.com/news/state/ohio-regulators-tu...

Oh nice, that basically solves the issue. I've been hearing horror stories of datacenters overloading existing grids and raising prices for the average person, If datacenters generate their own power that basically solves the issue.

Out here in AZ, solar combined with battery would be perfect for datacenters.

> If datacenters generate their own power that basically solves the issue.

If they do so cleanly otherwise they'll dump their externalities on the rest of us.

How many times has that happened so far?
Google is working with Kairos Power for nuclear reactors at their datacenters.

Microsoft struck a deal with Three Mile Island to get a reactor up.

And Amazon is working with Talen Energy.

Might be others I missed.

So the public is expected to deal with higher prices after every data center build? The work can't be done in advance?
> the public is expected to deal with higher prices after every data center build?

No. But the states that let companies put trillions of dollars of datacentre and power hardware in their borders will probably reap benefits from it for decades to come regardless of how AI pans out.

The real win/win would be to require them to build enough solar to power the operation.
> to build enough solar to power the operation

The most cost effective way to run a datacenter at some definition of "pedal to the metal", 24/7. This is not appropriate for solar, which is why these companies are looking into power sources that are most cost effective when they run pedal to the metal, 24/7, like nuclear.

And then the entire energy grid collapses with the AI bubble.
With all that extra cheap energy, we can start making more steel again. Desalinate water. There are a lot of things that can be done with vast amounts of underutilized cheap energy.