[websap]

How many companies at the size of Anthropic can serve the amount of traffic and manage the amount of compute they have?

[amelius]

It doesn't matter. Front end code should not misbehave if servers can't keep up. At worst it should fail gracefully.

[JackSlateur]

How many compagnies can manage a mostly stateless workload at "whatever-the-scale-because-it-does-not-matter-because-stateless" ? Lots of people can do that. Massive amount of people can do that.

[anuramat]

I think you mean mostly-stateless-but-with-prompt-caching-and-batching, ie not really

[slashdave]

The workload is anything besides stateless

[artursapek]

HN users are world champions are trivializing difficult things with snarky comments

[mypalmike]

I mean, it's Anthropic‘s front end, Michael. What could it cost? 10 dollars?

[websap]

Never forget - Dropbox!

[pton_xd]

I mean, supposedly software engineering is solved so it's somewhat justified snark.