Hacker News new | ask | show | jobs
by mayankchhabra 1040 days ago
The main difference is setting everything up yourself manually, downloading the modal, optimizing the parameters for best performance, running an API server and a UI front-end - which is out of reach for most non-technical people. With LlamaGPT, it's just one command: `docker compose up -d` or one click install for umbrelOS home server users.
3 comments
Multicomp 1040 days ago
Agreed.

Gpt4all[1] offers a similar 'simple setup' but with application exe downloads, but is arguably more like open core because the gpt4all makers (nomic?) want to sell you the vector database addon stuff on top.

[1]https://github.com/nomic-ai/gpt4all

I like this one because it feels more private / is not being pushed by a company that can do a rug pull. This can still do a rug pull, but it would be harder to do.

link
DrPhish 1040 days ago
Maybe I've been at this for too long and can't see the pitfalls of a normal user, but how is that easier than using an oobabooga one-click installer (an option that's been around "forever")?

I guess ooba one-click doesn't come with a model included, but is that really enough of a hurdle to stop someone from getting it going?

Maybe I'm not seeing the value proposition of this. Glad to be enlightened!

link
ShamelessC 1040 days ago
The difference is that this project has both "GPT" and "llama" in its name, and used the proper HN-bait - "self hosted, offline, private".

HN users (mostly) don't actually read or check anything and upvote mostly based on titles and subsequent early comments.

link
SubiculumCode 1040 days ago
thanks. yeah, that IS useful.

Anyone see if it contains utilities to import models from huggingface/github?

link