Questions tagged [ab-testing]

A way to test the UX of an application by displaying one version of it to 50% of the users of the application, and displaying another version to the rest of the users. You then compare how the two versions performed by using metrics such as click through rates, the average time on the site, etc.

7 questions with no upvoted or accepted answers
Filter by
Sorted by
Tagged with
3
votes
2answers
58 views

A/B testing usability with static user count

I'm new to A/B testing and I have few questions. The situation I would be testing an information system with no new users, so user count is more or less constant. In the system there is a big form ...
3
votes
0answers
39 views

UI/Process Design For A/B Testing

For fixed horizon A/B tests, the sample size needs to be determined based on alpha, beta, effect size and variance prior to a test. Therefore, in the experiment UI setup page, we need to ask users to ...
2
votes
2answers
168 views

Selecting the right user testing method for mobile app

We have a mobile app for different platforms. And now we want to improve the UX and UI. Due to the security policy, we cannot install analytic tools. I'm thinking of options we have to measure our ...
2
votes
3answers
111 views

How do test/compare an existing function with prototypes

I want to compare an existing function in an existing solution (search filters not being seen and/or used on our corporate intranet) with one or two prototypes. What's the best way to this? How do I ...
0
votes
0answers
39 views

A/B test in the moderated User Testing

Just wondering if it's common and practical to show our participants another version of our design to get their thoughts? My concern is validating version A without observing version B wouldn't be a ...
0
votes
0answers
26 views

Design test plans & evaluate results for an A/B test

My app aims at switching from monetizing with an ad only, to finding optimal revenue mechanisms between 03 models: ads, in-app purchases, and subscription. I want to increase its LTV at the same time ...
0
votes
2answers
55 views

Test Hypothesis On Multivariate Tests?

I was taught when A/B testing every test should be based on a test hypothesis, e.g. Control: Current Button (Blue) Test: White Button "We believe that changing the CTA colour (British English ...