[synaesthesisx]

How this compare to just running llama.cpp locally?

[mayankchhabra]

It's an entire app (with a chatbot UI) that takes away the technical legwork to run the model locally. It's a simple one line `docker compose up -d` on any machine, or one click install on umbrelOS home servers.