[jfries]

The user id can be used to seed the random number algorithm to achieve that.

[NewsAware]

Hmmm but if you change the distribution, this won't be deterministic anymore unless the randomness only applies to new users entering the test setup.

[tetrisgm]

Which is necessary. You don’t want to compare two wildly different users. This is why you need to define criteria for eligibility.