[numpad0]

Couple best vram for buck && borderline space heater GPUs off top of my head: Tesla K80(12GBx2), M40(24GB), Radeon Instinct MI(25|50|60|100)(8-32GB?), Radeon Pro V340(16GBx2), bunch of other Radeon Vega 8GB cards e.g. Vega 56, NVIDIA P102/P104(~16GB), Intel A770(16GB). Note: some of these are truly just space heaters.

I'm not sure if right now is the best timing for building an LLM rig, as Intel Arc B60(24GBx2) is about to go on sale. Or maybe it is to secure multiples of 16GB cards hastily offloaded before its launch?