Hacker News new | ask | show | jobs
by joedrew 4370 days ago
The #1 problem I've had in using external A/B testing platforms is that they allow flashes of the old content before the new is shown (if perhaps only for some users). We've seen huge problems with conversion when testing with those tools which we don't see when running A/B tests using server-side implementations.

If Wingify/VWO has solved this once and for all, it'd be wonderful.

1 comments

Curious about "huge problems". Is there must be some data you could share to demonstrate this?

(ie: conversions dipped x% when we didn't use a server-side implementation)

I'll have to look into the exact data, but conversions dipped at least 33% — even on the 'A' side.
That sounds incredibly high. What site is this on?