Hacker News new | ask | show | jobs
by arcticfox 1163 days ago
how does that help if you still have to have a DB tracking status? you still need the same order-of-magnitude of DB throughput
1 comments

No, because you only need to read and write ids and maybe timestamps to your db, both of which are trivially indexed, rather than the whole blob of your message payload.
In many cases, the message payload is (or should be) an ID anyway. It's seldom desirable for the message payload to include a copy of an external source of truth, because it can cause sync issues. There are exceptions, of course.
I don’t think it should be an ID - these platforms are really made for creating distributed event-driven systems.
The idea is your task should just run off an ID, no point passing all that data around.
How do you get the data relevant to that ID?

If the answer is a call to a shared database, you might as well not have RabbitMQ.