[wmf]

This kind of issue comes up in game development where I think the standard answer is a tier of proxies that can hold open the connection to the clients while reconnecting to different backends.

[k888sss]

Unfortunately, client code is not upgradable, and I have to solve this issue from server side only.

[neonlex]

I don’t understand your answer, that’s basically what wmf described. Put a proxy or load balancer in front of your service.

[k888sss]

Thanks. I can't upgrade clients to add reconnect functionality, and I can only work on the server side to solve the scaling issue. I think I should refactor my service as you mentioned by separating dedicated connection-managing servers and stateless worker servers such that I can scale workers.

[dominotw]

> I think I should refactor my service as you mentioned by separating dedicated connection-managing servers and stateless worker servers such that I can scale workers.

thats exactly what the original suggestion seemed to be was.

[k888sss]

Yupp. I think I misunderstood at first. Now I get it. Thanks all.