[Flux159]

This is nice to foster some competition in hardware for model training, but the availability of these machines seems very limited - I don't think there's any major cloud provider allowing per hour rental of Gaudi2 VMs and Intel's own site directs you to buy an 8x GPU provisioned server from Supermicro for more than 40k USD. Availability and software stack is still heavily in Nvidia's favor right now, but maybe by the end of the year that will start changing.

[memossy]

Think it'll probably crack on with Gaudi3 at 4x performance, twice VRAM etc later this year.

We found cuda sycl conversion surprisingly good https://www.intel.com/content/www/us/en/developer/articles/t...

[machdiamonds]

It's hard to guess these cards' real performance uplifts. According to Nvidia, H100 is 11x faster than A100, but that's definitely not true in most cases. If Gaudi3 is legitimately 4x faster than Gaudi2, it should be a very good value proposition compared to even the B100. I'm really curious whether Intel will be able to compete with X100 using Falcon Shores or not. Regardless, I don't think Nvidia's margins are sustainable.

[GaggiX]

>Intel's own site directs you to buy an 8x GPU provisioned server from Supermicro for more than 40k USD

Isn't that the price of a single H100?

[sabujp]

what you're telling me is that SMCI doesn't care if NVDA or INTC or even AMD outperforms on their hardware, they'll make axes and shovels for anyone and profit either way :)

[GC_tris]

Disclaimer: I technically still am employed at Genesis Cloud (though no longer actively involved).

Genesis Cloud started integration and testing of Gaudi2 quite a while ago. I fully agree with the take of the article.

I can't promise per hour rental, but for longer times they are available! (should you be interested you can find contact details on the website)

[az226]

Would you rent out a node for few days for benchmark testing?

[az226]

Link for the price?