2
votes
4answers
101 views

A/B testing in user test

I designed 4 versions of a checkout page. I want to make some user test to know which version performs better. Do you think that I have to do the tests with the same person? the big change in the ...
4
votes
1answer
179 views

A/B Testing Home Page of an Ecommerce Site

I am very new to any sort of website testing (please be gentle!), and I have some questions (mostly just for my own understanding) about A/B testing an ecommerce site's home page. The company I work ...
6
votes
1answer
253 views

A/B testing a site with low traffic

I've always been very interested in A/B testing, but have never had the opportunity to implement it on any websites. I work at a digital agency where the main reason why we haven't been able to ...
2
votes
2answers
73 views

What metric should I use for A/B testing of a blog homepage?

We are launching a blog about web design. The goal of our blog is of an ordinary content site - to get visitors to read as many articles as possible (NOT to get ad impressions). Our designer has ...
1
vote
1answer
96 views

I have a few significantly different layouts I want to test, is A/B or MVT testing the best approach?

I've read that A/B testing and MVT are best for testing smaller scale changes (i.e. button color, headline copy, etc), but are they also suitable for testing two (or more) very different designs? ...
1
vote
4answers
181 views

Who should be responsible for A/B testing and conversion optimization?

Currently, I'm wearing many hats, but looking to expand our team and eventually dedicate someone to running A/B, MVT and conversion optimizations for us. With companies where even minor % ...
3
votes
4answers
337 views

Testing OK/Cancel buttons

Related: OK/Cancel on left/right? I have been looking in to whether OK/Cancel should be on left or right, and after looking at lots of views on each side it seems there are good reasons for both. I ...
6
votes
2answers
309 views

Unexpected A/B testing results

We've just run an A/B test for one of our landing pages using Visual Website Optimizer. We are an online hotel booking reservation site. The landing page shows information about a particular hotel ...
5
votes
4answers
1k views

How to A/B test a published IOS and Android app on actual users?

I've published several apps on IOS and Android adding flurry to measure the interaction that is happening in those apps, however, I'd love to enhance this interaction and make my apps more useful by ...
2
votes
1answer
94 views

Multivariate test conversion: short vs long path

Let's assume we a workflow with 3 steps. Page 1 is our landing page. Page 2 is the form (signup). Page 3 is the conversion page (thank you page). To test variations on page 1, I am running a ...
6
votes
9answers
410 views

Isn't all user testing essentially a way of gathering how people think things should work?

When user testing is performed, users are often presented with a serious of variations of a product and observed to see where they excelled and where they had trouble. People will often click in areas ...
1
vote
1answer
116 views

Is there any testing methodology similar to A/B testing, but without a specific goal?

Please forgive me; this may be somewhat long-winded. I work in an academic library. I'd like to study how well assorted features of our site are serving our users' needs; for example, labeling of UI ...
1
vote
2answers
249 views

What other solutions do you use besides A/B tests for testing the efficiency of two site structures?

I've designed new site structures for one of our clients, and want to test which brings better conversion rates. using A/B testing seems obvious but are there any other solutions to cite ...
6
votes
2answers
211 views

Are there any easy to use A/B Testing frameworks?

How to do A/B testing is a difficult problem. Are there any frameworks or tools out there that ease the pain?
3
votes
5answers
410 views

Is A/B testing a worthwhile use of resources for the end user of a mobile app?

Web sites can enable A/B testing by serving a different page, for example. A mobile app would have to collect data and return it. As a matter of principle, is it okay to have software "phone home" ...
12
votes
5answers
301 views

Tips for A/B testing?

There seems to an increasing number of A/B testing services (such as Google Website Optimiser) and people using them. Have you got any tips on using and analysing the results from them?
10
votes
4answers
143 views

A/B Testing. How should it be done?

I just stumbled upon Google Website Optimizer. Is this the way to go? How do you normaly do A/B tests with your website?