Hacker News new | ask | show | jobs
by EvanMiller 4868 days ago
What, pray tell, is the hypothesis to be tested? Whether "my" or "your" results in more clicks? How do we know they aren't clicks borne of confusion? Whether "my" or "your" users visit the site more often? Over what time frame? A day? A week? A year? A decade?

A/B testing isn't magic fairy dust that settles design questions. You need to have a clear hypothesis to test. It's especially difficult if the design question concerns long-term perceptions and psychology. An A/B test in this situation is anything but straightforward.

I'd be interested to learn about how this design decision was made in the companies that have had to face it.

1 comments

Reduce how often users click back or cancel or close after attempting the action (I.e. to attempt to make them abort the action less often).