Hacker News new | ask | show | jobs
by junrushao1994 1038 days ago
tbh im not sure what amds plan is on ROCm support on consumer devices, but i dont really think amd is being fraudulent or something.

Both rocm and vulkan are supported in MLC LLM as mentioned in our blog post. we are aware that rocm is not sufficient to cover consumer hardwares, and in this case vulkan is a nice backup!
2 comments
ttctciyf 1038 days ago
If you click the "Radeon" tab here[1], dated 27 Jul, AMD claim ROCm support on a wide range of consumer cards, with HIP SDK support on RX 6800 and up, under Windows. The Linux situation seems less clear.

1: https://rocm.docs.amd.com/en/latest/release/windows_support....

link
imtringued 1037 days ago
Given AMDs track record. The 6900 will be dropped next year or early 2025.
link
zorgmonkey 1038 days ago
How does the performance with Vulkan compare to the ROCm performance on the same hardware?
link
junrushao1994 1038 days ago
We haven't done any comparison them yet, but generally we believe Vulkan as a more generic cross-vendor API should be slower than ROCm. Same for CUDA vs Vulkan.
link