Hacker News new | ask | show | jobs
by digitallyfree 1161 days ago
Privacy and security is a big desire for the people running these lower-quality local models. These assistants are becoming more and more powerful and people want to use them for personal tasks. For instance someone might want to chat about their inner feelings or ask the AI to pen a confidential letter, things that they wouldn't want to send to a cloud service. We saw the same thing with Stable Diffusion and how people would spend a lot of effort getting it to run on their machines so they wouldn't have to rely on a public instance.

I'm talking about individual people here as the fact that this is a leak means that corps probably won't take the legal risk of trying this out (maybe some are doing so in secret). In the business world there definitely is a want for locally hosted models for employees that can safely handle confidential inputs and outputs.

The Llama models are not as good as ChatGPT but there are new variants like Alpaca and Vicuna with improved quality. People are actively using them already to help with writing and as chatbots.

1 comments

> there are new variants like Alpaca and Vicuna with improved quality

Yeah, but still not even remotely close to ChatGPT. I can't use Vicuna for work. I heavily use ChatGPT & variants.