[Salgat]

To this day I do not get why Intel doesn't just offer massive memory options for their cards. Just charge what it costs to add the extra memory, no upcharge, and they will never be able to keep up with demand. Cheap VRAM is enough to justify a lot of open source investment into challenging CUDA.

[zozbot234]

> To this day I do not get why Intel doesn't just offer massive memory options for their cards.

They seem to? Intel Arc is the cheapest option by far for a discrete card with 32GB VRAM.

[Auracle]

That’s not massive, though. Make it 96GB at $2,000 (ok, probably impossible right now, but they could have before the surge in prices) and you’ll see developers work really hard to make AI tooling work for their cards, CUDA be damned. The same goes for AMD.

It’s like they both want to rely on market segmentation for VRAM too but fail to realize that it’s their only potential inroad right now.

[zozbot234]

If you buy three 32GB GPUs, that's 96GB total at a very reasonable price. An AI model splits easily by layers, so running on multiple GPUs is quite feasible.

[schubidubiduba]

Doesn't split as easily on an Intel GPU as ona NVIDA GPU though, regarding software support. Sure, it's probably not too difficult if you know what you're doing, but not sure how big that market would be.

[to11mtm]

They took longer than everyone expected and then shortly after release they made announcements that made people worry that Intel might kill the project the way they tend to kill GPU projects.

(I still kinda want to get one tho.)

[htrp]

Missed a zero here.

Needs 320 GB Vram

[ActorNightly]

Memory is just one part. AMD has had offerings competitive to NVIDIA for quite some time, but nobody uses AMD cards.

The biggest advantage with NVIDIA is CUDA.

[overfeed]

> but nobody uses AMD cards

AMD is selling every MI card it makes, and the market wants more of them.

[ActorNightly]

They are only selling because Nvidia is hard to get, and something is better than nothing.