[UncleOxidant]

https://github.com/philtomson/llama.cpp

[gorgonical]

Works like a charm for me, just like for you. Getting ~8 tok/s on my middle-of-the-road workstation laptop. Thanks for this!