Hacker News new | ask | show | jobs
by stingraycharles 16 days ago
So you think they’re running the same types of state of the art Nvidia deployments?
1 comments

It's supposed to be even MORE expensive:

Nvidia H100: Typically priced around $25,000–$30,000 (global MSRP).

Huawei Ascend 910C: Reported to cost roughly $28,000, yet it delivers only 60% of the inference performance of the Nvidia H100.

Google's TPUs are significantly cheaper for Google for inference. That's pretty much it.

There's a reason nVidia has an 80% margin right now.

MSRP is irrelevant in this context.