[vibe42]

The main server runs 3x RTX PRO 6000 (288 GB VRAM combined), power limited to 280W each (can crank it up as temps are fine but about to add some more fans first as the cards are stacked).

The second server is 2x Radeon RX 7900 XTX (48 GB VRAM combined). It's a fairly recent gaming PC that's being repurposed. Idea is to power limit those cards too and run some overnight stuff w small/medium sized models.

Intel just released some 32 GB VRAM cards, but sounds like support across AI tooling is a bit rough atm.

[nathan_douglas]

@#$% that's impressive. A little above my budget. I appreciate your response. I read some of your other comments and will follow your career with interest.