http://drjasondavis.com/blog/2013/09/12/eight-ways-youve-mis...
Can't tell you how many bad a/b tests we ran at Etsy until we figured things out ;)