[sillystuff]

Looks neat. Is there a way to pass through build flags to llama.cpp to build the Vulkan version (LLAMA_VULKAN=1)?

Llama.cpp using vulkan is great on laptop iGPUs.