Hacker News new | ask | show | jobs
by amelius 476 days ago
Why does it matter if you can run the LLM locally, if you're still running it on someone else's locked down computing platform?
1 comments

Running locally, your data is not sent outside of your security perimeter off to a remote data center.

If you are going to argue that the OS or even below that the hardware could be compromised to still enable exfiltration, that is true, but it is a whole different ballgame from using an external SaaS no matter what the service guarantees.