[brightball]

The way that Oban for Elixir and GoodJob for Ruby leverage PostgreSQL allows for very high throughput. It's not something that easily ports to other DBs.

[BowBun]

Appreciate the added context here, this is indeed some special sauce that challenges my prior assumptions!

[owaislone]

Interesting. Any docs that explain what/how they do this?

[TkTech]

A combination of LISTEN/NOTIFY for instantaneous reactivity, letting you get away with just periodic polling, and FOR UPDATE...SKIP LOCKED making it efficient and safe for parallel workers to grab tasks without co-ordination. It's actually covered in the article near the bottom there.

[owaislone]

Thank you

[brightball]

Good Job is a strong attempt. I believe it's based around Advisory Locks though.

https://github.com/bensheldon/good_job