[netdevphoenix]

Hasn't Anthropic being experiencing issues due to extremely high usage? Being their investor, you would think Amazon wouldn't do Anthropic dirty by weakening their ability to handle user traffic

[nateglims]

Amazon runs anthropic models in it's own DCs with Bedrock.

[brcmthrowaway]

How does this work?

Anthropic sends .gguf and a claude-serve binary?

[svachalek]

GGUF is mostly a hobbyist format, but yeah I'd assume it's a big pile of tensors and and executable.