|
|
|
|
|
|
by inhumantsar
601 days ago
|
|
|
I think you might be mixing things up a bit. the tolerance score wouldn't be tied to a specific change. it's an estimate of how tolerant a person is of changes generally. it's not that different from asking people if they want to be part of a beta testers group or if they would be open to being surveyed by market researchers. targeting like that usually doesn't have a significant impact on the results of individual experiments. |
|
|
Plus you don't know what that correlates to. Maybe being "tolerant of changes" correlates with being particularly computer-savvy, and you're rolling out changes that are difficult to navigate. Maybe it correlates to people who use your site only for a single task, it would appear they don't mind changes across the platform, but they don't see them. Maybe it correlates with people who hate your site now, and are happy you're changing it (but still hate it).
You can't use a selected subset that is not obviously uncorrelated from your target variable. This is selection bias as a service.