Hacker News new | ask | show | jobs
by anubhav200 2 days ago
Yes, llama.cpp, qwen 27b and 35b, llama-cpp-manager for managing model configs.(https://github.com/anubhavgupta/llama-cpp-manager)