BTW, how did you manage all of the throughput to the models and navigate the various throttling strategies for all the models you mentioned?

Looks really cool and useful. Seems like GPT-4o it's a lot better than 4.