[Oras]

Portkey does that with configuration. You assign a base model, then add more models with weight to load-balance.