24 votes
Accepted

Technical Term for 'Annoyances'

I call stuff like this "impediments", since stuff that causes annoyance to the user is basically stopping/impairing the user from what he is trying to achieve. But i think there are many words that ...
Pectoralis Major's user avatar
20 votes

A/B testing - client wanted the test run 70/30

Your statistical power is maximized if equal numbers of users are directed to A and B. That is, assuming one design really is better than the other, you’ll achieve statistical significance with the ...
Michael Zuschlag's user avatar
12 votes

Technical Term for 'Annoyances'

What about "obstacle"? It's a general term for something that is making something else difficult.
jazZRo's user avatar
  • 11.7k
11 votes

Technical Term for 'Annoyances'

If you are looking for a phrase that connects with technical UX literature, I suggest "cognitive burdens". The term cognitive burden /cognitive load comes from psychology, but it is commonly used in ...
Michael Heraghty's user avatar
10 votes

What do Sample Size and Effect Size mean in terms of A/B testing?

Effect Size In A/B testing, effect size is the observed difference in performance between A and B. Take, for example, the following A/B results: A: 10 conversions out of 103 visits B: 6 conversions ...
Michael Zuschlag's user avatar
8 votes

Is A/B testing the color of your button ethically acceptable?

Too me it sounds like you are trying to trigger the subconscious mind faster to take action, so the conscious mind has less time to make a decision. Isn't that partially a large part of UX? Reducing ...
Socrates Kolios's user avatar
7 votes

Technical Term for 'Annoyances'

i think the word you're looking for is "hindrance"?
gagan's user avatar
  • 71
5 votes
Accepted

How to determine when the A/B testing is needed?

I'd look at plotting the ideas on an Impact/Effort Matrix, and use that to prioritize. The low-effort, high-impact ideas would be prioritized first; the high-effort, low-impact deliverables would be ...
Izquierdo's user avatar
  • 12.5k
4 votes

How does e-commerce product quick view affect conversion rates?

Here's a great article from Baymard on Quick Views Baymard writes in their article that quick views often lead to small increases in conversion. However... Though quick views may slightly increase ...
Steven Wakabayashi's user avatar
4 votes
Accepted

Guidelines for stopping an A/B (or MVT) test early due to negative metrics

For starters, a rigorous Quality Assurance (QA) process is needed before launching a test. Your situation is quite common - find the variant losing only because it contained a bug. So you need to ...
em-v's user avatar
  • 164
4 votes

A/B testing - client wanted the test run 70/30

In theory, there isn't a problem with a client-ordered 70/30 test, as long as you're comparing conversion rates and not conversion amounts. If your hypothesis holds up, you'll still see the 5% dip ...
Izquierdo's user avatar
  • 12.5k
4 votes

A/B testing - client wanted the test run 70/30

Run A/B test on 60% of the traffic then. Diverged exactly 50/50 into old and new variants. Diverge all other 40% of users/sessions/views to new experience (as your client requests), but ignore them in ...
Frax's user avatar
  • 141
3 votes
Accepted

Reliability of Remote UX Tests (Screen cast, A/B)

This is the same as asking 'are surveys reliable?'. The reliability of an experiment depends on the methodology followed, context, participants and time. There are advantages and disadvantages of ...
Kristiyan Lukanov's user avatar
3 votes

Technical Term for 'Annoyances'

I'd argue to use... drumroll, dramatic pause Annoyance Most of the other suggestions to me suggest an actual prevention of progress. I'd also argue there any perceived non-professionalism is far ...
Austin French's user avatar
3 votes

Technical Term for 'Annoyances'

In the world of conversion optimization the most impactful way to convey the problem is: Bounce rate driver “Annoyances”, “interruptions”, “distractions”, and ...
plainclothes's user avatar
  • 21.3k
3 votes

How can i interpret the observed difference in a/b test?

You are correct that a significant null hypothesis result only tells you that A and B are different, but it doesn't quite tell you how different they could reasonably be, given the sample size and ...
Michael Zuschlag's user avatar
2 votes

Can you carry out AB testing without the site being live?

First to explain what A/B test is. Say you have a website where the homepage is really important. While you design it, you wonder whether it would be better to write in the heading section ( h1 tag)....
Kristiyan Lukanov's user avatar
2 votes

a/b testing hundreds of pages at once, with a different layout

It depends on how your "b" variant are implemented. Separate pages are difficult to test, whereas javascript transformations are much easier. Here is some general advice, hope it helps: Javascript ...
d-_-b's user avatar
  • 206
2 votes

Testing variables for video autoplay

First and foremost, you need to figure out what the goal of the test would be? The big question is: What result would you need to see for your team to implement autoplay (b) as a successful winner? ...
d-_-b's user avatar
  • 206
2 votes

Understanding uplift in A/B testing

Optimization tools usually give more statistics than the uplift %. Some will even tell you how many days/weeks the test should run given your current traffic, current conversion rate, and expected ...
d-_-b's user avatar
  • 206
2 votes

Should you ever test multiple A/B tests at the same time?

Multiple A/B tests not only are very common, but they are extremely useful, way more than simple A/B. However, it has a different name: Multivariate Testing. Just imagine this: I run a test for page ...
Devin's user avatar
  • 37.9k
2 votes

Technical Term for 'Annoyances'

I would use interruption. This has a highly negative connotation without being unprofessional. It also more succinctly communicates the actual nature of the problem. In both situations, the ...
jpmc26's user avatar
  • 128
2 votes

Technical Term for 'Annoyances'

I always use the term "visual clutter" as a non-technical term to describe things in a UI that have the potential to distract or confuse the user.
Franchesca's user avatar
  • 12.5k
2 votes

Technical Term for 'Annoyances'

Grievance is an alternative to annoyance that might fit the tone of what you're trying to convey: a real or imagined wrong or other cause for complaint or protest, especially unfair treatment. ...
Corbin Haughawout's user avatar
2 votes
Accepted

A/B testing usability [determine test group size]

Is there a way to measure if version A or B is better based on usability? Yes. Select what dimension of usability you want to pursue, and measure that. Usually, A/B tests measure “success” or “...
Michael Zuschlag's user avatar
2 votes

What is the minimum number of users i should do AB testing with to be effective?

Where Option A and Option B have markedly different response rates, 1000 is enough. Popular A/B test platform Optimizely, explains it this way: https://help.optimizely.com/Analyze_Results/...
RobC's user avatar
  • 1,539
2 votes

Is fair comparison a must in AB testing?

No, you can test different sizes as long as they're the only variable you measure. Otherwise, if changes go further (including the fact that a different size of 1 element could mean different ...
Devin's user avatar
  • 37.9k
2 votes

How do I know why people prefer our competitor's web site?

There could be lots of reasons why people prefer the competitor, ranging from habit, lack of awareness, or legit usability issues. "A/B testing" both sites would compare apples to oranges, because you ...
Wendy Wojenka's user avatar
2 votes

How do I know why people prefer our competitor's web site?

I think a better use of your time would be to interview the users as opposed to testing them, but before you even do that I would define who your users are by mental models. You need to distinguish ...
Jordan Reiser's user avatar
2 votes

Which version of A/B do I show if you happen to get different versions in two instances?

Usually, A/B testing involves comparing the behaviours of users exposed to A with the behaviours of users exposed to B. Ideally therefore each unique user should be exposed to either A or B, not both....
Lag's user avatar
  • 121

Only top scored, non community-wiki answers of a minimum length are eligible