Hacker News new | ask | show | jobs
by stoodder 5327 days ago
Have you A/B tested the retention rate of those users? I'd be interested in seeing if you kept more users with the prettier layout.
1 comments

No - it was a limitation of the test design, but it strictly measured just click-through performance for one step of the sales funnel. Other (equally important) considerations measuring quality of the interaction weren't measured. There's pros and cons of setting up the test this way, but I think that could be discussed for years :)