[vlovich123]

Is the CUDA compat layer AMD has that transparently compiled existing CUDA just fine insufficient somehow or buggy somehow? Or are you just stuck in the mindshare game and haven’t reevaluate whether the AMD situation has changed this year?

[the__alchemist]

I haven't checkout out AMD's transparency layer and know nothing about it. I tried to get vkFFT working in addition to cuFFT for a specific computation, but can't get it working right; crickets on the GH issue I posted.

I use Vulkan for graphics, but Vulkan compute is a mess.

I'm not in a mindshare, and this isn't a political thing. I am just trying to get the job done, and have observed that no alternative has stepped up to nvidia's CUDA from a usability perspective.

[vlovich123]

I didn’t talk about Vulkan compute.

> have observed that no alternative has stepped up to nvidia's CUDA from a usability perspective.

I’m saying this is a mindshare thing if you haven’t evaluated ROCm / HIP. HIPify can convert CUDA source to HIP automatically and HIP is very similar syntax to CUDA.

[the__alchemist]

TY; will check those out.

[jakogut]

There's also ZLUDA, which can run llama.cpp and some other CUDA workloads already without any modification, but it's still maturing.