[Philpax]

Depending on what you're doing, 2x used 3090s are the same price and offer you more VRAM. That's what I'm planning on doing, in any case - being able to run 70B LLMs entirely on the GPU is more useful than being able to run 34B faster.

[icelancer]

Yeah multiple 3090s is the best budget way to go for sure. Also older server boards with tons of PCIe lanes if you can swing rack mounted hardware and have some technical skills.

[biddit]

Agreed. I recently completed a new build with two 3090 GPUs and really appreciate being able to run 70b models.

[Dowwie]

which cpu did you go with?

[biddit]

i7-14700k

z790 chipset w/ mobo that supports x8/x8 bifurcation

96gb ddr5 @5600mhz