[EamonnMR]

What you can do is have a really large number of partitions and scale consumers up only when needed (workers need not be 1:1 with partitions.)