Hacker News new | ask | show | jobs
by m4xt3r 4742 days ago
Alright, that was a bold statement on my side. That's true for 99.9% of the companies, not 100%.

Again, most of us don't have enough traffic to make successful buton color tests.

2 comments

Have you tried MAB ? It seems like the best way to do A/B testing on small-traffic pages, let it run forever without losing much due to the reduced frequency of poorly performing variantes.

Setup your test with 3 or 4 colors, the programm will automatically pick the best one over time, so it doesn't matter how long you let it run, be it weeks months or years, and when you don't want to test it anymore you pick the one that performed the best out of the many visitors you've had over a large period.

http://en.wikipedia.org/wiki/Multi-armed_bandit

thank you!

i cannot tell you how excited i get when a client wants to split only to change a color of a button or a subtle change in a particular font. so frustrating!