Hacker News new | ask | show | jobs
by hacker_homie 10 days ago
Investigate local llm on company owned hardware it’s really the only way to be sure.
2 comments

Well that as the set up is non-negotiable (it legally has to be on premises); the issue is a model nonetheless exfiltrating data if we give it any network access.
Wouldn't a local llm be just as vulnerable to this?