Hacker News new | ask | show | jobs
by zbentley 775 days ago
> It is hard to believe that users can tolerate a produce message latency of hundreds of milliseconds with WarpStream

I think that the critical axes of competition (for your company and for WarpStream) here are latency distribution versus cost and durability. Many users might be willing to tolerate produce latency in the 100s of milliseconds at the p99, provided the p50 is fast and the messaging system is cheap to operate. The same tradeoff applies for durability: if the p999 stays fast in exchange for replicated in-memory buffers being the sole residence of data before batched shipment to S3-alike, some users might be less (or more!) interested in that messaging product.