Hacker News new | ask | show | jobs
by UltraSane 295 days ago
Since the routing is opaque they can dynamically route queries to cheaper models when demand is high.