[backend-dev-33]

> additional challenge of offering it over a network socket across multiple requests and doing so in a performant manner.

@kkielhofner thanks a lot! now I realize it. I see, there is even GRPC support in Triton, so it make sense.

[kkielhofner]

Make sure to check out the existing Triton client libraries:

https://github.com/triton-inference-server/client