Hacker News new | ask | show | jobs
by EdwardDiego 1051 days ago
Kafka isn't even a queue. I've done consulting on Kafka, and several times my recommendation is "You don't want or need Kafka".

A classic sign of "you wanted an MQ" is when a consumer writes a message to a topic to let the producer know it read the message the producer wrote...

3 comments

> A classic sign of "you wanted an MQ" is when a consumer writes a message to a topic to let the producer know it read the message the producer wrote...

Oof. Queued RPC is such a siren song; so many developers either stumble into this pattern or seek it out. And it's such a pain. Suddenly the latency of (often user-sensitive) operations is contingent on the latency of a queue consumer plus the time it takes to process everything in the queue before the RPC was issued. Goodbye, predictable turnaround times.

"but MQ is, like, so 1998, we want new and cool and GCP told us we needed Kafka"
Right. Kafka is a database. ;-)
Anything is a database if you're brave enough :D
The bravery is in using what has traditionally been called a database. ;-)

https://youtu.be/05mVvkp6f2M