Hacker News new | ask | show | jobs
by sva_ 486 days ago
I don't think the RAM size of the H800 was nerfed (80GB), but rather the memory bandwidth between gpus.

But yeah, would be interesting to see how they optimized for that.

1 comments

Correct. There are 3 main ways to "gimp" high end GPUs meant for training - "cores", "on-chip memory speed" and "interconnects". IIUC the H800 had the first 2 unchanged but halved the interconnect speeds.

H20 is the next iteration of the "sanctions" that I believe also limited the "cores" but left the on-chip memory intact, or slightly higher (from the new generation).