[robertclaus]

I think fail-over for a production critical service is an equally important responsibility of the router.

[ramraj07]

You cant fail over to a different model though. Even failing over to a different provider isn't always as simple as set it and forget it. For example bedrock doesn't support the tool search tool feature from anthropic.

[brunaxLorax]

I didn't know that! I thought that all models had the same features no matter the provider

[jml78]

They beta support for it now I believe

[brunaxLorax]

Yes, providers have downtime and retry/fallback solves this problem.