[ycui1986]

i always thought Ryzen AI Halo, together with DGS Spark, has mismatched compute capacity with memory size. Given 128GB VRAM, people would want to run large models, but the GPU compute is constraint in these types of use case. If the box runs models that don't need high compute, then there is no need of 128GB VRAM.

On the high end side, it is too slow. On the low end size, it waste money on VRAM.

[mortoc]

I bought one of this system back when you could get one for $1800 (the GMKTek Ryzen AI Halo 128gb machine). It's a very good dev machine, the 16 core CPU is quite good for development work. I find this is a useful configuration for local LLMs with plenty of RAM left over for doing actual work on the system (split something like 64 system, 64 dedicated to LLMs).

I don't think I'd pay $4k for it today though, 2 years ago and less than half the price feels like a good machine. I'd be very disappointed in it today for $4k.