Hacker News new | ask | show | jobs
by dantiberian 3365 days ago
> Because Kafka message expiry has only two policies, as far as I could tell: time or space.

You can use log compaction to remove all messages apart from the latest for any given key. This gives you a Kafka queue with a bounded size, that is proportional to the table size that you're replicating.

https://kafka.apache.org/documentation/#compaction