Hacker News new | ask | show | jobs
by packetlost 478 days ago
This card is marketed to consumers, not AI developers. Most people who will buy these cards don't even know what ROCm is.

Edit: it just doesn't matter for launch day. It'll likely be supported eventually.

6 comments

Every Nvidia card has CUDA support from day one, regardless of who the market is for it. I wouldn't much as much if all their slides weren't covered in AI, AI, AI, and it didn't ship with some stupid LLM chatbot to help you tune your GPU.
Why can't consumers dabble in AI?

When I explained my non-technical friend who is addicted to ChatGPT that she could run models locally her eyes got lighten up and she wants to buy a graphics card, but she is not doing any gaming.

I think having CUDA available in consumer cards probably played a big part in it being the de facto "AI framework." AMD would be wise to do the same thing.
> not AI developers

Yet their slides show INT8 and INT8 with Sparsity performance improvements. As well as "Supercharged AI Performance".

Those features are probably used by FSR4. The 9070 isn't very attractive for LLMs though.
The slides mention Stable Diffusion and Flux as a benchmark.
Developers introduction to a technical ecosystem is more than likely using the card they already own. And "It'll likely be supported eventually" just signals that they're not serious about investing in their software. AMD is selling enough CPUs to finance a few developers.
I mean that's one way to guarantee availability for gamers!