[onlyrealcuzzo]

Energy is like 10-20% of the cost of AI.

The rest is mostly hardware depreciation.

[cmiles8]

Correct. There are challenges getting enough energy to new data center builds but the cost of the energy is low relative to other costs.

[stingraycharles]

So you think they’re running the same types of state of the art Nvidia deployments?

[onlyrealcuzzo]

It's supposed to be even MORE expensive:

Nvidia H100: Typically priced around $25,000–$30,000 (global MSRP).

Huawei Ascend 910C: Reported to cost roughly $28,000, yet it delivers only 60% of the inference performance of the Nvidia H100.

Google's TPUs are significantly cheaper for Google for inference. That's pretty much it.

There's a reason nVidia has an 80% margin right now.

[thrownthatway]

MSRP is irrelevant in this context.