[xrd]

I have three 3090 cards. Are you saying you run them together using specialized hardware or can I somehow combine them using software over Ethernet?

[suprjami]

If you have either PCIe slots or risers you can put them in the one system.

llama.cpp will let you run inference remotely across different systems but I suspect this would be far too latent to be worthwhile. If you have three systems already then it would cost you a few minutes to test it.