[hvass]

I would be curious to know what percentage of teams with statisticians / data people actually use tools like Optimizely? A lot of people seem to be building their own frameworks that use a lot of different algorithms (two-armed bandits, etc.). From my understanding, Optimizely is really aimed at marketers without much statistical knowledge.

Of course, if you're a startup, building an A/B testing tool is your last priority, so you would use an existing solution.

Are there much more advanced 'out-of-the-box' tools for testing out there besides the usual suspects, i.e. Optimizely, Monetate, VWO, etc.?