[suprfnk]

But then, if an agent picks the best response, how would you know that that is reliable?

[xienze]

Obviously you have multiple agents justify why they picked a certain response and then create another agent that picks the solution with the best justification.

[kkyr]

touché

[onion2k]

You could get the agents to output something structured and then use a deterministic test if you're worried about that.