Hacker News new | ask | show | jobs
by zbentley 3104 days ago
Having the number of parallel consumers configured per-queue (as opposed to consumers dynamically being able to join and leave) seems like it imposes many of the same restrictions that make Kafka less than ideal at being a job queue.

Basically, if you have messages which can take different amounts of time to process, or you need to quickly dynamically scale the number of consumers on a queue in response to volume.

How well does the "update max_workers" queue-modification command work in situations of very high message volume and/or high consumer counts?