[radicalbyte]

I've built systems similar to this dozens of times and what they're doing makes no sense. Use a database table to store the state of a given job and query it. Super fast, efficient and you're not hiding state in what should be an ephemeral part of your infrastructure.

The MQ is great for scheduling jobs, passing data between different parts of a given process and generally detaching systems. However fast it is not, unless you're using something like Zero MQ for slow IPC.