[skirmish]

They prefer you pay $3,600 for AMD Radeon Pro W7900, 48GB VRAM.

[anthonix1]

... which also has a much lower power cap

[skirmish]

Not that much lower, 295W vs 355W, and for LLM inference VRAM bandwidth is the main bottleneck. But the price is ridiculous.