Hacker News new | ask | show | jobs
by nateglims 27 days ago
Amazon runs anthropic models in it's own DCs with Bedrock.
1 comments
brcmthrowaway 27 days ago
How does this work?

Anthropic sends .gguf and a claude-serve binary?

link
svachalek 27 days ago
GGUF is mostly a hobbyist format, but yeah I'd assume it's a big pile of tensors and and executable.
link