Hacker News new | ask | show | jobs
by uberex 39 days ago
What is the idiots guude to run this one local now?
3 comments

Ask an existing LLM harness like Claude Code. "Install this and run the demo program" or "Set this up with llama-server" or "Give me an Open WebUI page for this model" will work.
Use LM Studio.
how do I get these weights in particular?
omlx makes it quite easy