[code51]

The idea that these little experiment wins bring user satisfaction and/or revenue increase is a pure assumption.

Employees get so aligned with these experiment systems that obvious faults in statistical approaches go unnoticed. At the end of the day it becomes just a way to put something on your promotion case.

In most cases, core product stays the same over the years without significant innovation.