Hacker News new | ask | show | jobs
by SV_BubbleTime 462 days ago
AMD’s is coming up in support for things like torch and xformers. But it isn’t there yet.

If you want for AI, your best bet is a used 3090 for $700-800. The ram is more important and that card is still faster than a 4070.

1 comments

AMD has documentation for its assembly language as I remember. Or one needs more documentation to run AI?
Isn’t a documentation issue.

The entire ecosystem is built around CUDA currently. There was someone implementing Cuda on AMD hardware but as I understand it, AMD shut that down.

There are two alternatives to CUDA for AMD right now, but I forget their names.

AMD has STRIX coming, which is a single board embedded ram machine, and is being targeted at AI loads with lots of low latency ram. So we’ll see what happens there.