Agree. It's a terrible time to want a new Nvidia card for gaming or AI projects. I had a 4070 Ti Super in my cart for a while at a cool $700 on Amazon - now it's out of stock and secondhand I can find it for double that now.
If one doesn't require the latest DLSS or need first-class AI support, get an AMD card.
The entire ecosystem is built around CUDA currently. There was someone implementing Cuda on AMD hardware but as I understand it, AMD shut that down.
There are two alternatives to CUDA for AMD right now, but I forget their names.
AMD has STRIX coming, which is a single board embedded ram machine, and is being targeted at AI loads with lots of low latency ram. So we’ll see what happens there.
Thankfully the ONNX runtime supports AMD's ROCm. The performance is nowhere close to Nvidia's TensorRT, but doing inference on an AMD GPU is doable. I haven't ran the numbers, but I wouldn't be surprised if you could get more throughput per dollar on an AMD GPU for at least some scenarios. AFAIK there aren't any great options for training though, so if you want to do anything besides running ONNX models your options are limited.
It's probably false to say they're leaving money on the table. They'd be leaving a lot more money on the table if they allocated chips towards consumer gaming GPUs instead of maxing out the server AI/GPU compute segment. The entire gaming market constitutes like 15%-or-less of their revenue nowadays.
And Nvidia has enough mindshare that they could piss on consumers for the next 3 release cycles and still have more than half the market. I don't like it but it's reality.
The top end should at least be stocked because a lot of us are using cards locally for AI that eventually runs in the cloud.
So yeah they did leave $2600 from me on the table that is now becoming more likely to be spent on a bootleg 48GB 4090 than a 5090 and if I get that they won’t see money from me for many years till they beat 48GB in consumer form factor.
Yep, all 10 they shipped sold instantly at 2x MSRP. Prices on 3090's (not a typo) are going up ffs, because there is nothing out there on the NVIDIA front.
This made me curious, so I just took a look on eBay.
My 4070 Ti that I bought (new, oops) this past December has appreciated 20 - 25%! At least according to what people have them listed for... no idea if anyone is actually buying them at those prices.
Of course even if I managed to sell it, everything else has gone up in that time, so it's not like I'd get to make money on the deal. Pretty wild, nonetheless!
Egg production fell because of avian flu, which the US has regulatory restrictions limiting the usage of the vaccine in agriculture compared to other developed nations. Its not an intentional crisis.
Egg prices raised because the government asked for the killing of a hundred million of chickens - for fear of spreading bird flu. It may have been the right call, we’ll never know.
Small difference, but important.
Here, CNN is obscuring the fact that the chickens killed were not tested or confirmed to have flu, but some around them might have so they had to go too.
NVidia doesn't make the chips, they just design them, so it is a flex. People are literally buying their cards faster than they can be produced. TSMC is building new fabs to make more nvidia chips faster.
NVidia decide how they allocate their wafer starts at TSMC. Consumer chips have lower margin than datacenter parts, so they almost certainly allocated comparatively little volume to consumer chips.
On the one hand, this is a great situation to be in for Nvidia in terms of overall revenue.
On the other hand, this has allowed AMD to grab market share with the RX 9000 series launch, at least in the short term. So the narrow point that Geforce is sold out is decidedly not a flex.
If one doesn't require the latest DLSS or need first-class AI support, get an AMD card.