> For N balls, the other balls can/should be binary searched.
> It's just a little tricky when it comes to the last two.
Well, it is trivial with two balls, once you get it, but it's tricky with respect to "just binary search".