24
votes
Accepted
Technical Term for 'Annoyances'
I call stuff like this "impediments", since stuff that causes annoyance to the user is basically stopping/impairing the user from what he is trying to achieve.
But i think there are many words that ...
- 10.8k
20
votes
A/B testing - client wanted the test run 70/30
Your statistical power is maximized if equal numbers of users are directed to A and B. That is, assuming one design really is better than the other, you’ll achieve statistical significance with the ...
- 37.7k
12
votes
Technical Term for 'Annoyances'
What about "obstacle"?
It's a general term for something that is making something else difficult.
- 11.1k
11
votes
Technical Term for 'Annoyances'
If you are looking for a phrase that connects with technical UX literature, I suggest "cognitive burdens".
The term cognitive burden /cognitive load comes from psychology, but it is commonly used in ...
- 2,537
10
votes
What do Sample Size and Effect Size mean in terms of A/B testing?
Effect Size
In A/B testing, effect size is the observed difference in performance between A and B. Take, for example, the following A/B results:
A: 10 conversions out of 103 visits
B: 6 conversions ...
- 37.7k
8
votes
Is A/B testing the color of your button ethically acceptable?
Too me it sounds like you are trying to trigger the subconscious mind faster to take action, so the conscious mind has less time to make a decision.
Isn't that partially a large part of UX? Reducing ...
- 1,751
7
votes
5
votes
Accepted
How to determine when the A/B testing is needed?
I'd look at plotting the ideas on an Impact/Effort Matrix, and use that to prioritize. The low-effort, high-impact ideas would be prioritized first; the high-effort, low-impact deliverables would be ...
- 12k
4
votes
How does e-commerce product quick view affect conversion rates?
Here's a great article from Baymard on Quick Views
Baymard writes in their article that quick views often lead to small increases in conversion. However...
Though quick views may slightly increase ...
4
votes
A/B testing - client wanted the test run 70/30
In theory, there isn't a problem with a client-ordered 70/30 test, as long as you're comparing conversion rates and not conversion amounts. If your hypothesis holds up, you'll still see the 5% dip ...
- 12k
4
votes
A/B testing - client wanted the test run 70/30
Run A/B test on 60% of the traffic then. Diverged exactly 50/50 into old and new variants.
Diverge all other 40% of users/sessions/views to new experience (as your client requests), but ignore them in ...
- 141
3
votes
Accepted
Reliability of Remote UX Tests (Screen cast, A/B)
This is the same as asking 'are surveys reliable?'. The reliability of an experiment depends on the methodology followed, context, participants and time.
There are advantages and disadvantages of ...
- 11.5k
3
votes
Accepted
Guidelines for stopping an A/B (or MVT) test early due to negative metrics
For starters, a rigorous Quality Assurance (QA) process is needed before launching a test. Your situation is quite common - find the variant losing only because it contained a bug.
So you need to ...
- 154
3
votes
How do Enterprise Softwares validate A/B testing?
Test in Context
First, I understand your explanation of the difference between having the choice to use software and not having the choice, but I don't really see how that's going to affect your ...
- 11.6k
3
votes
Technical Term for 'Annoyances'
I'd argue to use...
drumroll, dramatic pause
Annoyance
Most of the other suggestions to me suggest an actual prevention of progress.
I'd also argue there any perceived non-professionalism is far ...
- 1,379
3
votes
Technical Term for 'Annoyances'
In the world of conversion optimization the most impactful way to convey the problem is:
Bounce rate driver
“Annoyances”, “interruptions”, “distractions”, and ...
- 21.2k
3
votes
How can i interpret the observed difference in a/b test?
You are correct that a significant null hypothesis result only tells you that A and B are different, but it doesn't quite tell you how different they could reasonably be, given the sample size and ...
- 37.7k
2
votes
Accepted
How long should we test every option in an A/B test?
Smashing magazine published a nice article about AB testing best practices and a link to calculator of audience you need to ensure your results are statistically significant.
Check these links:
...
- 675
2
votes
Accepted
How do Enterprise Softwares validate A/B testing?
(most) Enterprise A/B testing tools will give you a margin of error calculation given your desired confidence index.
What this means, (assuming you want 90% confidence)
<confidence %> of the ...
- 206
2
votes
Can you carry out AB testing without the site being live?
First to explain what A/B test is.
Say you have a website where the homepage is really important. While you design it, you wonder whether it would be better to write in the heading section ( h1 tag)....
- 11.5k
2
votes
Testing variables for video autoplay
First and foremost, you need to figure out what the goal of the test would be?
The big question is: What result would you need to see for your team to implement autoplay (b) as a successful winner?
...
- 206
2
votes
Understanding uplift in A/B testing
Optimization tools usually give more statistics than the uplift %. Some will even tell you how many days/weeks the test should run given your current traffic, current conversion rate, and expected ...
- 206
2
votes
Should you ever test multiple A/B tests at the same time?
Multiple A/B tests not only are very common, but they are extremely useful, way more than simple A/B. However, it has a different name: Multivariate Testing.
Just imagine this: I run a test for page ...
- 36.5k
2
votes
a/b testing hundreds of pages at once, with a different layout
It depends on how your "b" variant are implemented. Separate pages are difficult to test, whereas javascript transformations are much easier.
Here is some general advice, hope it helps:
Javascript ...
- 206
2
votes
Accepted
A/B testing usability [determine test group size]
Is there a way to measure if version A or B is better based on usability?
Yes. Select what dimension of usability you want to pursue, and measure that. Usually, A/B tests measure “success” or “...
- 37.7k
2
votes
What is the minimum number of users i should do AB testing with to be effective?
Where Option A and Option B have markedly different response rates, 1000 is enough.
Popular A/B test platform Optimizely, explains it this way: https://help.optimizely.com/Analyze_Results/...
- 1,529
2
votes
Is fair comparison a must in AB testing?
No, you can test different sizes as long as they're the only variable you measure. Otherwise, if changes go further (including the fact that a different size of 1 element could mean different ...
- 36.5k
2
votes
Technical Term for 'Annoyances'
Grievance is an alternative to annoyance that might fit the tone of what you're trying to convey:
a real or imagined wrong or other cause for complaint or protest, especially unfair treatment.
...
2
votes
Technical Term for 'Annoyances'
I always use the term "visual clutter" as a non-technical term to describe things in a UI that have the potential to distract or confuse the user.
- 12.5k
2
votes
Technical Term for 'Annoyances'
I would use interruption. This has a highly negative connotation without being unprofessional. It also more succinctly communicates the actual nature of the problem.
In both situations, the ...
- 128
Only top scored, non community-wiki answers of a minimum length are eligible