Hacker News new | ask | show | jobs
by auspiv 18 days ago
Statistically speaking if each part of the Luna run has a 90% chance of being correct, 5 of those is 0.9^5 = 0.59 = 59%. Or one Sol run being maybe 95% correct? Exact numbers vary of course. But then again having sol verify at end may be cheaper.
1 comments

The goal is not 100% correctness. The goal is to demonstrate the current amount of variance / uncertainty to the planning agent.

If the planner sees that 4/5 Luna runs resulted in approximately the same summary, it may conclude that variance is low and that it is over the target. If all Luna runs are different, the planner can conclude that additional research rounds are required.