[jimfuller]

just noticing the comment 'When a server is being stopped, we need to make sure we don’t lose any incoming data.'... the potential for data lose is already present with the use of redis server ?

I guess I am missing something.

[tarekmoz]

I don't know all the details on the project and if there are some single point of failures, but as far as Circus is concerned, a properly working graceful shutdown is a must-have when your app is getting data to process.

e.g. 1/ notify the world you don't accept data anymore 2/ process what you have enqueued 3/ shutdown. In Fabien's use case 1 -> 3 can last for over 5 minutes.

[jimfuller]

thx, I think I understand what you are saying,

my (perhaps snarky) comment was more to do with 'why be so careful' with the potential data failure (that circus handily addresses) when data is being placed in a 'leaky bucket' (redis) in the first place.