[dtgriscom]

There are facts about human behavior which can only be learned by actually testing them. People are complex in ways that you, whilst sitting at your keyboard, cannot figure out.

[tornato7]

All which can be learned through focus groups and internal feedback, no need to further confuse and frustrate your users.

[szundi]

After you have the engine running, the marginal cost of an A/B is probably smaller than a focus group test. So if you really believe in focus groups for the results and you are also ambitious enough - probably this means go for A/B.

Disclaimer: just thinking, not knowing the costs

[tornato7]

Definitely agree, though I think the point of this thread is we don’t know the “true cost” of A/B testing in terms of long-term lost user engagement.

Have we done an A/B test for A/B testing where we test A/B testing…

[fshbbdssbbgdd]

It’s very common to think something is a good idea based on focus groups and internal feedback and then learn it’s a bad idea from launching it (or running an AB test).