Nvidia H100: Typically priced around $25,000–$30,000 (global MSRP).
Huawei Ascend 910C: Reported to cost roughly $28,000, yet it delivers only 60% of the inference performance of the Nvidia H100.
Google's TPUs are significantly cheaper for Google for inference. That's pretty much it.
There's a reason nVidia has an 80% margin right now.
Nvidia H100: Typically priced around $25,000–$30,000 (global MSRP).
Huawei Ascend 910C: Reported to cost roughly $28,000, yet it delivers only 60% of the inference performance of the Nvidia H100.
Google's TPUs are significantly cheaper for Google for inference. That's pretty much it.
There's a reason nVidia has an 80% margin right now.