Hacker News new | ask | show | jobs
by jeffail 2865 days ago
Hey, the HTTP output has a fixed number of retries, after which you could either have some mechanism in place to fall back on or by default it will simply continue the retries again whilst blocking upstream. You might also be interested in running Benthos in streams mode: https://github.com/Jeffail/benthos/tree/master/docs/streams

Streams mode lets you run as many isolated stream pipelines as you want in the same process, which in your case could be a simple queue -> webhook bridge. You can manage these pipelines either statically in config files, or dynamically through a REST API.

1 comments

That seems really promising, especially configuring pipelines with API calls. Many wheels may be left uninvented.

Thank you for making your work available!