Hacker News new | ask | show | jobs
by Fronzie 535 days ago
There has been some testing within llama.cpp, which supports both Vulkan and ROCM-Blas. When it works, the latter is about 2x faster than the Vulkan version.