My Private LLM Setup at Home, Confidentially Accessible on Mobile

Y	Hacker News new \| ask \| show \| jobs

	My Private LLM Setup at Home, Confidentially Accessible on Mobile (thin.computer)
	4 points by thethindev 835 days ago

2 comments

I setup a simple homelab on a macbook air and added ollama + open webui. Now I have an LLM I can talk to whenever I'm out.

I'm using llama2 and llama2-uncensored, but I'm going to download llava and mixtral later. Either way, it's been a great experience

This is exactly the type of setup I'm interested on replicating on my end. Thanks a lot for the post!!

Are you planning on fine-tunning the LLM further for your own needs? Have you thought about that?

> This is exactly the type of setup I'm interested on replicating on my end. Thanks a lot for the post!!

My pleasure!

> Are you planning on fine-tunning the LLM further for your own needs? Have you thought about that?

Initially, I wasn't thinking about it but it looks easy enough [1][2]!