[bsaul]

"The write path. We built a daemon that would select log entries that were older than two weeks, copy them into a file in S3, and delete the rows from the database"

Seriously... How can you ever consider saying "a rdbms is just fine as a kafka alternative" under those conditions ?

[xupybd]

How does Kafka solve this problem any better?

Your messages expire so if you want to archive you need a consumer to write them to disk. That sounds very similar.

[peterhunt]

Why not?

[andrewstuart]

Ideology.

There's alot of people who are ideologically opposed to database backed message queues. They're usually reluctant to give detailed explanations why, because it's an emotional thing.

[bsaul]

Because that would be equivalent to saying « rdbms are fine as a kafka alternative provided you build a compensation mechanism for all the things it does worse than kafka». It doesn’t make any sense.