Hacker News new | ask | show | jobs
by moffkalast 806 days ago
It would be interesting if this could be made into a reasonably priced (lmao) card for home inference if they intend to mass produce it.

Can't imagine any other reason other than cost as to why they went with LPDDR5, LPDDR5X has more bandwidth and GDDR6 has even more.

1 comments

they didn't use GDDR cause they wanted the memory capacity which is really important for recommendation models. But I totally agree that this is a sort of perfect cost/perf per watt point for a home setup. I really hope they do it, if not for this one at least for v3.