Hacker News new | ask | show | jobs
by anubhav200 2 days ago
Yes, llama.cpp, qwen27b, 35b, claude code. Llama-cpp-manager for managing llama.cpp configs (https://github.com/anubhavgupta/llama-cpp-manager)
1 comments

Machine: CPU: intel 275hx GPU: Nvidia 5090 Mobile (24GB) RAM: 64GB
One more thing, I also use it along with Whisper-NPU, a speech to text utility that runs on NPU of Intel 275hx and doesn't consumes any GPU resources.