I have a feeling this will go the way of Optane and once it becomes useful they'll pull it and shelve it while keeping the patents/license of course so no one else can improve on it
cries I am sad at all of the cool designs that would work with optane if it had been widely adopted. We desperately need more points on the latency/cost per GB curve.
One can only imagine how much money Intel would have made from Optane during the ongoing RAM shortages. It would be absolutely perfect for warm KV cache, and potentially good for MoE expert offloading.