[jonstewart]

We will be half-to-single rack scale for a while, so I'm not too too worried about operations--we also need to target solo workstations, which is the real challenge with any of these systems. If things go haywire, we can just restart processing later.

[cbsmith]

You might want to check out Kafka Streams.