Hacker News new | ask | show | jobs
by sparkling 31 days ago
What is your motivation? Privacy and/or data protection?

I currently don't see a world where it makes sense to run a local model that will eats up 60% of my RAM, 20-30% of my disk space while providing worse quality output than a $20/month subscription.
2 comments
nozzlegear 31 days ago
> What is your motivation? Privacy and/or data protection?

For me, those things are nice benefits but not the motivation. It's just a desire to own my tools and remove the magic wherever possible, and not pay a big corporation who is constantly tweaking/changing things that I might not like. It's the same reason I migrated everything I host off of Azure and onto a VPS, and why I moved from Jetbrains Rider to Neovim, and so on.

link
kingnothing 31 days ago
You can let a local LLM run loops all night or all weekend and it costs nothing. It works offline. There's no rate limits. Privacy. You aren't tied to the whims of the US Government banning models. You can tie it in to HomeAssistant for home automation tasks very easily.
link