Hacker News new | ask | show | jobs
by johann8384 179 days ago
But, it isn't running locally. It uses tools locally but the LLM is still shipping the output of those tools to Anthropic and running the inference there.

A compromise to this would be Bedrock but that still ships the data to Amazon to execute the LLM on their processors.