[Workaccount2]

Based on leaks, it looks like intel somehow missed an easy opportunity here. There is an insane demand for high VRAM cards now, and it seems the next intel cards will be 12GB.

Intel, screw everything else, just pack as much VRAM in those as you can. Build it and they will come.

[dheera]

Exactly, I'd love to have 1TB of RAM that can be accessed at 6000 MT/s.

[talldayo]

Optane is crying and punching the walls right now.

[yjftsjthsd-h]

Does optane have an advantage over RAM here?

[watersb]

Optane products were sold as DIMMS with single-DIMM capacity as high as 512 GB. With an Intel memory controller that could make it look like DRAM.

512 GB.

It was slower than conventional DRAM.

But for AI models, Optane may have an advantage: it's bit-addressable.

I'm not aware of any memory controllers that exposed that single-bit granularity; Optane was fighting to create a niche for itself, between DRAM and NAND Flash: pretending to be both, when it was neither.

Bit-level operations, computational units in the same device as massive storage, is an architecture that has yet to be developed.

AI GPUs try to be such an architecture by plopping 16GB of HBM next to a sea of little dot-product engines.

[wtallis]

> But for AI models, Optane may have an advantage: it's bit-addressable.

That's an advantage over NAND but not over DRAM. Fundamentally, DRAM is also bit-addressable, but everybody uses DRAM parts with memory cells organized into a hierarchy of groupings for reasons that mostly apply to 3D XPoint memory.