Hacker News new | ask | show | jobs
by echelon 2 hours ago
Or not routing at all.

In practice you just pick one and stick with it until the API stops or you hit performance issues.

1 comments

The choice on the first turn is super important for this reason! But if a user prompt sends the convo in a very different direction then often it does make sense to reroute at that point.