[skybrian]

It sounds like the explore / exploit trade off as seen in a multi-armed bandit problem.

Also, a known source of randomness (that you add yourself or already occurring) is pretty important for determining causality.