[Aurornis]

> Examples like self hosted LLM finetuning and RAG on an old dell or HP server with these type of cards on them.

This won’t be in the price range of an old Dell server or a fun impulse buy for a hobbyist. 160GB of raw LPDDR5X chips alone is not cheap.

This is a server/workstation grade card and the price is going where the market will allow. Consider that an nVidia card with almost half the RAM is going to cost $8K or more. That price point is probably the starting point for where this will be priced, too.

[matt-p]

Maybe not old but if this was say a 6k card that would make it accessible to pretty much any business and at least some hobbyists. 160GB of Lpddr5 should be less than 2k, so it's easily doable if they've got the will. 4 x 5090s is 128GB and probs much more powerful at ~8k, so it would need to be 6/7k to make it make sense.

[vardump]

That nVidia card is going to have 5x the memory bandwidth. LPDDR5X is going to be rather low bandwidth.

(My guess is Intel's card is only going to have about 400 GB/s bandwidth.)

[matt-p]

Last year's M4 max MacBook is 520GB/s and (I expect) that should be closer to 1TB/s in a year or two by the time they are using ddr5. It would be deeply embarrassing if they had worse performance than apples cheaper laptop.