Hacker News new | ask | show | jobs
by ulf-77723 626 days ago
Worked at an A/B Test SaaS company as a solutions engineer and to my knowledge every vendor is capable of delivering solutions for those problems.

Some advertise with those things, but the big ones take it for granted. Usually before a test will be developed the project manager will assist in mentioning critical questions about the test setup

1 comments

Pretty sure most don't. Most A/B Test SAAS vendors cater to lightweight clickstream optimization, which is why they don't have features like Stratified Sampling. Internal systems are lightyears ahead of most SAAS vendors.
I work at Statsig and we built it recently: https://statsig.com/updates/update/stratified-sampling. Definitely still some internal systems that are way ahead of SaaS but we're seeing more companies ditch internal builds for us.