Hacker News new | ask | show | jobs
by schwax 2675 days ago
Anybody have a recommendation for an A/B testing service?

We've talked to Optimizely but their pricing was going to come in at the same ballpark as our AWS spend (into the six-figure range), which seems absurd. They charge based on monthly users, but a lot of our traffic consists of organic search bounces.

For now we just want to run ~5 experiments per month, want to record events server-side so we can be sure not to lose any, and are wary about implementing it ourselves since there are so many ways to screw it up without realizing it.

5 comments

You could try the free version of Google Optimize if you don't mind using a Google product.
We use Hansel
At one place I worked we got around Optimizely pricing by only sending down Optimizely code to some small subset of our users — enough to yield statistical significance but not so much to break the bank.
You can use VWO.com

PS: it’s a product that I launched here on HN 9 years ago and wouldn’t have been possible without the awesome community.

It's not that hard to DIY. You can start with: https://facebook.github.io/planout/
Split (https://www.split.io/) works pretty well for us