[peterangular]

Yep - and I'm entirely skeptical of people who singularly use a singular "A/B" study to back up any case when it comes to a real business' sales funnel. Simple input masking or not - it just wouldn't hold up in some of the board rooms I've had to stand in front of during my career... the phrase "not statistically significant" comes to mind.

And before you link that "A/B Testing is Still Needed" HBR article - know that I 100% agree with it but on the premise of testing MULTIPLE solutions under the traditional "A/B testing" model. As far as you've posited in this conversation - you guys only tried one thing. You're also admitting it's not a "scientific study" so I assume you did nothing to minimize other changing variables/conditions in regards to the input masking.

TLDR: Input masking CC fields is probably a bad idea beyond filtering non-numeric/non-slash characters. I will make that generalization. I'm not convinced you've got a valid argument against that with your "A/B test" experience.

[root_axis]

> I'm entirely skeptical of people who singularly use a singular "A/B" study to back up any case when it comes to a real business' sales funnel.

You're skeptical of people who test their business process and follow the data where it leads them rather than taking the advice of arrogant internet curmudgeons that try to puff up their opinions with flippant allusions to statistical significance and vague appeals to the authority of "board room" war stories? That doesn't speak very well for your own credibility.

> You're also admitting it's not a "scientific study" so I assume you did nothing to minimize other changing variables/conditions in regards to the input masking.

Well that assumption might make it easier for you to justify your haughty screed but it's also incorrect (you can apply that to your edits as well). Unlike you, I'm not arrogant enough to suggest that the insights I've gained in my own personal experiences are totally absolute and generalizable to every other business and circumstance.

> I'm not convinced you've got a valid argument against that with your "A/B test" experience.

That's the aspect you don't seem to be grasping; I have no reason to care about your opinion since it flies directly in the face of the data I've seen and you haven't provided any support besides your own feelings about why formatting credit numbers kills conversation rates. At best, both our experiences are anecdotal, the only difference is I'm not a dick about it.

[Aeolun]

That all depends on what the results of that A/B test were.

If it was a 50% increase in signups over a set of 1000 cases, I’d be inclined to say it’s statistically significant.

[TeMPOraL]

That's assuming they tested for one masked/non-masked input only and not bundled it with other redesigns, or didn't have other confounders like a sale, or marketing campaign, etc. Also that they did run this as a trial for set amount of time, and not until Optimizely told them that the B-version is outperforming A-version (common A/B testing pitfall).

Overall, seeing the UX crap produced by many data-driven companies (Google included), I have low trust in their methodology.

[Aeolun]

Fair enough, but those are kind of testing 101, so I’d be a bit dissapointed if they influenced the numbers given.

[TeMPOraL]

Given my personal experience in this industry, and around adtech companies, I wouldn't. It's easy to get things wrong, and hard to verify against reality.