Hacker News new | ask | show | jobs
by plaidfuji 15 days ago
To put that in perspective, if you assume a token is 4 bytes, that’s about 164 MB/s of traffic, which sounds a bit less staggering.
1 comments

Dealing with a lot of traffic for a small team isn't hard in itself. If it is easy to parallelise you just need to horizontally scale. And most concerns can be added as sidecars or middleware. Rate limits, auth, etc. Basically this is a kubernetes cluster. For a 3 person startup hard. For 50 pretty managable.
And if you were a smaller team then you don't even need K8s. Just ECS or Cloud Run have simple abstractions for horizontally scalable services and sidecars support.