Hacker News new | ask | show | jobs
by bombcar 1327 days ago
If you do A/B testing wrong it can be bad (search around that and you’ll find stuff)

If you maximize signups you may be fishing with too large a net and catch customers who aren’t appropriate. A/B won’t tell you that.

You may end up at a local maxima optimizing things when you should be fixing major real issues.

Experimentation should have a hypothesis and a test, not throwing stuff at the wall to see what sticks.