Hacker News new | ask | show | jobs
by navjack27 696 days ago
Yeah I'm not sure how this is privacy focused if it's still using API. I have local models that could run on my CPU that have pretty big context windows that would be pretty cool if this could just plug into and keep everything local.
1 comments

Great question.

By privacy focused - I mean there is no backend servers that log chat or store embeddings. All data is stored locally.

And OpenAI API, doesn't use data from API for training.

Local models are on the roadmap. So far they just don't perform good enough to get anything meaningful done. Highly recommend Sonnet 3.5!