167 votes

How do you get users to think aloud?

Use a rubber duck. No, seriously! Put a little rubber duck near the user. Tell the user the rubber duck's name - the more non-fitting, the better. Mine is called Frank The Duck. You see, Frank The ...
T. Sar's user avatar
  • 1,161
70 votes
Accepted

UX in the wild vs UX observed

Yes, it's known as the Hawthorne Effect and it's one of many cognitive bias' to be aware of when running usability testing sessions. From Wikipedia The Hawthorne effect (also referred to as the ...
JonW's user avatar
  • 37.2k
45 votes
Accepted

How can I ensure users don't fear the word TEST in the invitation for usability testing?

This is something worth paying attention to. Aside from the highschool/college exam flashback anxiety you talk about, the Hawthorne Effect suggests that "individuals modify or improve an aspect of ...
dennislees's user avatar
  • 11.6k
23 votes

How do you get users to think aloud?

Jakob Nielsen suggests making and showing participants a 1 minute video of a think-aloud session. In summary, his criteria for such a video are: Use your own staff to act as the participant Don't ...
calum_b's user avatar
  • 2,263
22 votes

Is it a Good UX to keep both star and smiley rating system as filters?

I could be wrong but I think here the smiley faces are the only rating system. The stars are a filter for 3 star hotels, 4 star hotels, etc.... Which....yes. Isn't immediately obvious at all and is ...
the other one's user avatar
22 votes
Accepted

How many test participants to 'prove' an issue?

You asked if there is any statistics that can be used to essentially determine if the 10 people you are testing with are especially dumb. Essentially what you're asking is: What is the likelihood ...
user6916458's user avatar
20 votes
Accepted

What to do if SUS scores contradict qualitative feedback?

How can this discrepancy be reconciled? You have divergent results because the number of participants is small and not representative. There is no randomization or blinding to prevent bias. You're ...
習約塔's user avatar
  • 1,885
18 votes
Accepted

What is the difference between alert, notification banner and toast message?

Notifications choice often depend on what system you are building for. If you are building for an existing platform e.g. an iOS app or Android app, then most platforms have guidelines which are in ...
stradled's user avatar
  • 2,527
18 votes

How many test participants to 'prove' an issue?

In one study I discovered "5 out of 5 users couldn't complete the task" in the past, and my stakeholders simply didn't believe the data. So this is a something to consider. While Nielsen advocates 5 ...
SteveD's user avatar
  • 8,904
17 votes

Alert colors are really user-friendly to color-blind users?

Quick Answer In your case that color scheme is NOT safe for colorblind people. First of all don't forget that there are different types of color vision deficiency. Let's summarize why your image is ...
Adriano Repetti's user avatar
16 votes

Keyboard shortcut keys for Tabs?

Most IDEs, Web Browsers, and other TDI software use CtrlTab for switching tabs no matter which UI element currently has focus. References: Chrome keyboard shortcuts Mozilla Keyboard shortcuts ...
dotancohen's user avatar
  • 1,109
14 votes
Accepted

Do users behave differently to interactive lo-fi wireframes compared to hi-fi mockups in user testing sessions

There are some differences yes, and I have witnessed them myself. Using high fidelity mock-ups makes users think that the system they are using is fully functioning. That makes them think that system ...
locationunknown's user avatar
14 votes
Accepted

Minimum Maximum slider - Usability best practice

I think your UI is quite clear, and will not cause any misunderstanding with the user. You may make it more aesthetic, by lowering the number of elements in the UI. This UI may be cleaner and clear ...
Tal Yaron's user avatar
  • 424
14 votes
Accepted

Are remote preference tests (A vs. B) always flawed because of learning effect?

Well, as you say, the obvious answer is to randomize (there are other, more sophisticated ways to do this, but probably too much for what you're looking for). If you use the same pool of participants ...
Devin's user avatar
  • 36.6k
13 votes

How do you get users to think aloud?

I use running questions like: What are you thinking now? What do you think you need to do next? Why do you want to click that button? What do you expect to happen when you click there? Was that what ...
Roux Martin's user avatar
  • 14.2k
13 votes

How to explain the difference between user research and user testing to stakeholders?

As @sclarke has already put it, research is done before testing. You can't cook a meal without knowing what the ingredients are. Same with UX, you can't start to test if you don't know what your tests ...
Kitanga Nday's user avatar
  • 1,639
11 votes

What to do if SUS scores contradict qualitative feedback?

How to reconcile the discrepancy? That I can't tell but here is why it might have happened. The "5 users will find everything wrong with your system" refers to usability problems test subjects will ...
locationunknown's user avatar
11 votes
Accepted

What is a good reason to tell clients who want their logo to be always included in every screen that it shouldn't be done for a mobile app?

If the client says the logo must appear on all the company screens, even those of the mobile application is absolutely correct and of course, they are in their right to say that. But, this is where ...
Danielillo's user avatar
  • 17.8k
10 votes

What do Sample Size and Effect Size mean in terms of A/B testing?

Effect Size In A/B testing, effect size is the observed difference in performance between A and B. Take, for example, the following A/B results: A: 10 conversions out of 103 visits B: 6 conversions ...
Michael Zuschlag's user avatar
10 votes
Accepted

USER TESTING alternative phrase

I think it's the word user that's more of an issue than the word testing. After all, you're testing the product not the user. In fact, the chances are that your user testing script reminds you to ...
Roger Attrill's user avatar
10 votes
Accepted

Designing for users without meeting them

To be honest with you, this happens way more than UX designers would like to admit. Especially at the start of your career, without a more senior UXer, you won't always be able to persuade the ...
Martyn's user avatar
  • 2,298
9 votes
Accepted

UX Strategy for MVP's

I'm not sure you understand what minimum viable product is. The minimum viable product is the minimum your users will accept/pay for. If you were inventing mechanised transport for the first time ...
Roux Martin's user avatar
  • 14.2k
8 votes

How can I ensure users don't fear the word TEST in the invitation for usability testing?

It's all in the phrasing and perception of who is being targeted. Below are a few suggestions: Please help us evaluate our new online ordering system Try out our new online ordering system, ...
MonkeyZeus's user avatar
  • 5,648
8 votes
Accepted

What user experience level to target with usability testing?

It is probably best to spread the participants across as many relevant user types as possible. The most valuable in any group of test participants is always the first one, by a large margin. In one of ...
Vitaly Mijiritsky's user avatar
8 votes

Is guerilla testing meant to be ad hoc and improvised?

Guerrilla testing is a common and low cost method of testing, which is by definition ad hoc. Its goal is to get quick feedback whenever you need it. As you said, all testing should be thought about ...
SteveD's user avatar
  • 8,904
8 votes

Alert colors are really user-friendly to color-blind users?

You should consider checking any color palette options using an on-line simulator such as Coblis (http://www.color-blindness.com/coblis-color-blindness-simulator/), which shows you how images look ...
Mattynabib's user avatar
  • 3,386
8 votes

Minimum Maximum slider - Usability best practice

EDIT: Scrap the input box, @vinay is right. It would just make the whole thing more complex. So it will end up looking like this: OK, before I share what I think you should do, I think it's best I ...
Kitanga Nday's user avatar
  • 1,639
8 votes
Accepted

Mobile Button - When tapping (before releasing), should it grow or shrink?

TL;DR: Both methods can work. Shrinking is more logical but has less visibility because of the user's finger. Growing is not corresponding to expectations of real life but the interaction is better ...
Big_Chair's user avatar
  • 6,806
7 votes

How can I ensure users don't fear the word TEST in the invitation for usability testing?

Depending on the users involved, I've heard usability tests called "Usability feedback sessions" or "usability sessions". (This usually comes up on meeting invites and other 'impersonal' communication ...
Alex Feinman's user avatar
  • 6,254
7 votes

What to do if SUS scores contradict qualitative feedback?

Look at your confidence intervals: the "real" score for v1 is somewhere between 58 and 88, while that score for v2 is somewhere between 51 and 79. Most notably, the confidence interval for each score ...
Mark's user avatar
  • 1,875

Only top scored, non community-wiki answers of a minimum length are eligible