Hacker News new | ask | show | jobs
by Havoc 647 days ago
> Typical crypto miner setup.

Except not doing the sketchy x1 pcie lanes. That’s the part that makes nice LLM setups hard

1 comments

Can you tell me what's sketchy about it? I have not had an issue with any one of the 12 extenders and bandwidth held well without any issues. Please explain if possible if LLM requires a different type of extender.
Eh perhaps poor choice of words.

It works fine for crypto but LLM performance is far more sensitive to bandwidth. You lose a ton of performance if you’ve got PCIe in the loop, never mind one lane pcie. That’s why nvlink is (was) a thing - trying to cut that out entirely.

Got it. I was planning to switch my miners to LLM farm. I will test and see how much of a difference it will make. Thanks.