[alecco]

AFAIK, unless you are a huge American corp with orders above $100m Nvidia will only sell you old and expensive server cards like the crappy A40 PCIe 4.0 48GB GDDR6 at $5,000. Good luck getting SXM H100s or GH200.

If Intel sells a stackable kit with a lot of RAM and a reasonable interconnect a lot of corporate customers will buy. It doesn't even have to be that good, just half way between PCIe 5.0 and NVLink.

But it seems they are still too stuck in their old ways. I wouldn't count on them waking up. Nor AMD. It's sad.

[ponector]

Parent comment requested non-enterprise, consumer grade GPU with tons of memory. I'm sure there is no market for this.

However, server solutions could have some traction.

[alecco]

Hobbyists are stacking 3090s with NVLink.