Hacker News new | ask | show | jobs
by chabons 805 days ago
> Intel Gaudi 3 has more interconnect bandwidth than this has memory bandwidth.

LPDDR5 vs HBMe2. I'm guessing there's a 2-5x price difference between those, but even so it's an interesting choice, I don't know any other accelerators which spec DDR. But yeah, without exact TCO numbers it's hard to compare exactly.
1 comments
namibj 805 days ago
Bandwidth is far more power hungry for DDR, but capacity is far cheaper.

If the bandwidth capability of DDR suffices, HBM isn't worth it.

At least with LPDDR's; GDDRs may well not be worth it under data center TCO considerations due to the high interface power usage. Feel free to correct me if I'm mistaken, the numbers in question aren't too easy to search for so I didn't confirm this (LPDDR vs. GDDR) part.

link