Hacker News new | ask | show | jobs
by albert_e 1041 days ago
Oh I thought this was a quick guide to host it on any server (AWS / other clouds) of our choosing.
2 comments

I had the same question initially, was a bit confused by the Umbrel reference at the top, but there's a section right below it titled "Install LlamaGPT anywhere else" which I think should work on any machine.

As an aside, UmbrelOS actually seems like a cool concept by itself btw, good to see these "self hosted cloud" projects coming together in a unified UI, I may investigate this more at some point.

Yes! It can run on any home server or cloud server.
Interesting. I might try to get this to work on my NAS.
Good luck! The token/sec will be under your expectations or it will overheat. You really shouldn't play games with your data-storage. You could try it with an old laptop to see how bad it performs. Ruining your NAS for this is a bit over the top to show, that "it worked somehow". But i don't know, maybe your NAS has a powerful processor and is tuned to the max and you have redundancy and don't care to loose a NAS? Or this was just a joke and i fell for it! ;)
Not sure how powerful their NAS is, but on Umbrel Home (which has an N5105 CPU), it's pretty useable with ~3 tokens generated per second.