[nhumrich]

This is a cool idea, but having the worker use http is just asking for problems. What happens if the http connection times out? For a worker architecture, it can be expected for some jobs to take north of 5 minutes. Http will time out by then, but the worker will still keep on going.

[dabernathy89]

aren't there long-lived http connections? e.g., https://developer.twitter.com/en/docs/tweets/filter-realtime...

[heavenlyblue]

You’re mentioning HTTP as an issue when the persistence layer behind the queue is based on MySQL, which does not seem to be in any way relevant here.