[vatican_banker]

The tool currently allows only one set of strong and weak models.

I’d be really good to allow more than two models and change dynamically based on multiple constraints like latency, reasoning complexity, costs, etc.

[voiper1]

I think unify.ai (like openrouter) does that - it has several paramters you can choose from.

But the underlying "how to choose a model that's smart enough but not too smart" seems difficult to understand.

[TechDebtDevin]

Its just sentiment analysis.

[Oras]

Portkey does that with configuration. You assign a base model, then add more models with weight to load-balance.

[KTibow]

Some of that is already possible, since it can generate a difficulty score for a prompt that could be manually mapped between models based on ranges.

[ModelBox]

actually ModelBox(model.box) offers that, the autorouter function can dynamically switch to different models according to latency, geo-position and costs.