[civilitty]

Or there’s a trade off between more complex schemas and logit bias going off the rails since there’s probably little to no backtracking.

[newhouseb]

Good point. Backtracking is certainly possible but it is probably tricky to parallelize at scale if you're trying to coalesce and slam through a bunch of concurrent (unrelated) requests with minimal pre-emption.