[Onawa]

We get rate limited when using Azure's OpenAI API. As a gov contractor working with AI, I have limited means for getting access to frontier LLMs. So routing tools that can fail over to another model can be useful.

[fkyoureadthedoc]

Same. Initially we just load balanced between various regions, ultimately bought some PTUs.