Hacker News new | ask | show | jobs
Ask HN: Self-hosting LLMs, is it worth the setup?
1 points by sb13 501 days ago
With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?
1 comments

people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind.
I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?