Hacker News new | ask | show | jobs
Kafka Parallel Consumer (github.com)
2 points by antonmry 1428 days ago
1 comments

This library lets you process messages in parallel via a single Kafka Consumer meaning you can increase consumer parallelism without increasing the number of partitions in the topic you intend to process. For many use cases this improves both throughput and latency by reducing load on your brokers. It also opens up new use cases like extreme parallelism, external data enrichment, and queuing.