|
|
|
|
|
by EdwardDiego
2356 days ago
|
|
> However, we can’t use Kafka as a queuing system because the maximum number of workers you can have is limited by the number of partitions, and because there is no way to acknowledge messages at the individual message level. You would need to manually commit offsets in Kafka by maintaining a record of individual message acknowledgments in your own data store, which adds a lot of extra overhead — too much overhead in my opinion. I just want to clarify this - you're limited to N concurrent consumers for N partitions per consumer group. |
|