Hacker News new | ask | show | jobs
by alphagrep12345 2162 days ago
How does it compare to other A/B testing apps? Eg: https://apps.shopify.com/neat-ab
1 comments

Neat A/B is a 100% daily traffic swap app. This approach isn't a valid a/b test since it isn't properly isolating the variable (price).
Neat A/B Testing here! First off, congratulations on the launch. I would argue showing different prices to simultaneous visitors is an ethical gray area - not to say it's not something that shops do, or wish to do. But that's why we choose to cycle pricing. In our experience, with proper consideration of cycle timing, test length and traffic consistency, it's possible to get solid results this way.
Hey there! Thanks for the congrats. I see your point, but external factors + different cohorts visting throughout the test is a bit of a pickle. Nonetheless, I wish you the best!