We use Kafka a lot within the company I work for. I think it's great.
The only thing I miss is fast lookups based on some key and/or the ability for subscribers to only receive messages for certain keys.
That’s most likely the trade off between the queue and a log. The property of the log is having to look at every message.
The prefixes can be somewhat done with a custom partitioner, the lookup requires another technology. The only way to know the final value under the key is to look at the complete log.
The prefixes can be somewhat done with a custom partitioner, the lookup requires another technology. The only way to know the final value under the key is to look at the complete log.