What's the use case for these high end graphics card? Is it for professional use or do gamers actually buy this? Which games require such high end graphics?
Actual use cases? Ludicrously quick AI inferencing, media transcoding, 3D render offloading, SIMD-bound simulations and anything that uses CUDA. Dedicated graphics will dominate in these scenarios, and it's such a large market that the 4090 is hardly the tip of the iceberg. Nvidia's server-grade AI chips are genuine monsters. People definitely use these cards, and there's a demand to scale them for datacenters too.
Gaming still drives the sales, but you'd be surprised by what you can do with a $500 GPU plugged into a Linux box.
Is there really datacenter demand for these anymore?
In addition to the Nvidia EULA against "datacenter use" they (allegedly) shut down the last dual slot 3090 (with server compatible cooling configuration) because it was eating at higher margin datacenter SKUs[0].
I don't see a lot of datacenters making use of a 3.5U card with challenging power and cooling requirements but I certainly could be wrong.
What’s the point of the infamous “No Datacenter Deployment. The SOFTWARE is not licensed for datacenter deployment, except that blockchain processing in a datacenter is permitted.” clause if it only applies to Windows?
if you're making multiple images in a batch, you should be able to run those in parallel. or have one GPU training concepts (e.g. textual inversion) while the other renders, or if you're doing style transfer you could do frames in parallel.
hmm ok valid point. if I can run two instances of the software & configure it to use separate GPUs I should be OK. I'll have to see if I can try that out somehow.
"Had" to buy a 3090 at msrp during the pandemic, because everything else had big markups on it.
It turns out, just being able to max everything out, have raytracing, and play at 4k/60 is just a much fancier but vapid way of accessorizing playing videogames.
No game "requires" a really high-end graphics card, but some can certainly take advantage of it if you're into pretty, high-resolution, high-framerate graphics.
Gaming still drives the sales, but you'd be surprised by what you can do with a $500 GPU plugged into a Linux box.