Hacker News new | ask | show | jobs
by ryanworl 978 days ago
[WarpStream co-founder]

WarpStream doesn't implement compacted topics today. It is on our roadmap, though. Compacted topics are typically not used in high-throughput workloads, so our plan is to delay compactions for longer than a disk-based system would to trade space amplification for write amplification.

1 comments

Thanks for clarifying.

> Compacted topics are typically not used in high-throughput workloads

TIL, but it makes sense. Compaction/retention policies certainly introduce a lot of extra tradeoffs dimensions.