Hacker News new | ask | show | jobs
by lysace 666 days ago
Does my codebase leave my machine when using your extension with it?
1 comments

Yes, some code is sent to Anthropic. We're hoping to: find initial users that are comfortable with software copilots (github copilot, cursor, etc) -> iterate on their feedback to make diagram generation require less sophisticated LLMs -> move everything locally
This will be a no go for more and more large companies.

We just had a major incident because someone accidentally uploaded our codebase via a VS code extension, lawyers, everything involved. I expect that non local AI tools will be banned soon.

Think about it, what 3rd party tool would you let scrape your whole codebase and send it to their server?

Makes total sense, and sorry to hear about the incident. At the moment, closed source models are the only viable way to generate high quality diagrams. Once that changes, we'd prefer to switch to open source too for many of the reasons you mentioned.
Sent via your servers, I assume, since you are providing the Anthropic api key.

So we must trust both Anthropic's and your infrastructure with our code.

I agree that a local LLM is the way to go.

That's correct, our server just routes calls directly to Anthropic. Some users requested an option to input their own API key and talk to Anthropic directly. I'll add this by the end of the week, maybe today if time.

Local LLM is still the end goal

Ok. I think you should be more transparent about this, until everything is local.

I mean, more than stating "We don't store any of your code."

Got it, how about a manual trigger for diagram creation and an explicit description of LLM/server usage on the page with the trigger?
Maybe just the truth in plain text, up front?