20
votes
Accepted
What to do if SUS scores contradict qualitative feedback?
How can this discrepancy be reconciled?
You have divergent results because the number of participants is small and not representative. There is no randomization or blinding to prevent bias. You're ...
- 1,870
11
votes
What to do if SUS scores contradict qualitative feedback?
How to reconcile the discrepancy? That I can't tell but here is why it might have happened.
The "5 users will find everything wrong with your system" refers to usability problems test subjects will ...
- 5,408
7
votes
What to do if SUS scores contradict qualitative feedback?
Look at your confidence intervals: the "real" score for v1 is somewhere between 58 and 88, while that score for v2 is somewhere between 51 and 79. Most notably, the confidence interval for each score ...
- 1,885
3
votes
UX Researcher Hiring Challenge Ideas
I would strongly recommend you pick a research problem that is relevant to your organization, perhaps one that you've already finished, and have the research candidate walk through it face-to-face in ...
- 12.9k
3
votes
How do you uncover true motivations and goals during user research?
I think there's something here to be said for not asking 'why' and trying to understand their true rationale deeper. In a workplace context their entire rationale possible is that, and knowing why won'...
- 31
3
votes
Accepted
How to perform user interviews for a new product when there are IP restrictions
The question "Due to the actual cost of gas, would you like your car to run on a cheaper kind of energy rather than gas?" will not , on it's own, cause any kind of intellectual property issues. It ...
- 14.2k
2
votes
Accepted
UX Interview Questions
"How many long have you been using [the product]?" - what do you expect this question to reveal?
"How would you rate your overall familiarity with [the product]?" - what do you expect this question ...
- 730
2
votes
Accepted
Interview brief wording advice
Let's break this down.
...registration Call to Action "component"...that encourages registration ... [and] could be repurposed in the header, footer, middle of a page - wherever you propose
"[...
- 2,503
2
votes
Accepted
App on-boarding via contextual imagery
May I know the goal of these questionaires? are you trying to personalize the feeds base on user's choices or? You have mentioned that there will be a simple animation prior to these questions, so I ...
- 116
2
votes
Interview methods for user needs phase
Your initial approach seems like a good start. Have a look at the following resources hopefully this will give you some guidance:
Is asking 'balanced' leading questions the right way during user
...
- 344
2
votes
Accepted
How much incentives is too much?
The Nielson Norman Group is an excellent resource on a wide variety of UX topics. In this case they've actually conducted a study on how people incentivize recruits, among many other things.
They ...
- 116
2
votes
What to do if SUS scores contradict qualitative feedback?
I think the most important thing is to realize that using a combination of qualitative and quantitative analysis methods is going to give you the most complete best picture of what the users are ...
- 27.7k
1
vote
interview users best practices
You have discovered the reason musicians do soundchecks :)
In the context of software procurement this means that you should try your workflows in the software(s) in question in a setting that is ...
- 2,598
1
vote
How do you uncover true motivations and goals during user research?
The technique, i.e., asking 'why' multiple times, is correct. However, the success of this interview technique depends on the question/interview design. The laddering technique is underpinned by the ...
- 46
1
vote
How do you uncover true motivations and goals during user research?
Maybe you could start digging back into their history. When they decided to pursue the current profession, what went through their heads back then. Maybe there are some simply forgotten motivations as ...
- 5,628
1
vote
What are filler words that you can use for responding to users' saying in user interview?
I sometimes use...
"Curious, what else?" or
"I'll note that, continue?" or
"Do you see other items of interest?" or
"Great observation!"
Each of these is situational, and I use them to both ...
- 91
1
vote
Questions in Usability Testing without giving any lead
Use task based activities that require the use of the feature you want to test and base your questions around the problem that our feature sets out to solve rather than the feature itself.
Lets say ...
- 14.2k
1
vote
Questions in Usability Testing without giving any lead
When testing usability, think of which hypothesis you want to validate and which scenarios you have to work with. Based on those, create tasks that will help you measure how well you perform or solve ...
- 293
1
vote
2nd UX interview with Agile guy
I have only experienced working in an agile once and it wasn't fun.
In user research we call this a small sample size.
...[they] did not give me a seat at the table.
And no one ever will. You ...
- 1,537
1
vote
UX Interview Questions
Instead of asking "Which of the below do you do most often? (select multiple if applicable)*" and "What are the most common tasks you do when using [the product]?", I would ask "How often do you ...
- 467
1
vote
Accepted
Should I tell interviewees remaining time for tests?
Interesting question and observation!
I feel like the answer to this would be dependent on what you want to achieve from the test and how you want to achieve it.
For OBSERVING the Psychology of the ...
- 6,819
1
vote
How many people should i interview for my project realization?
Is it possible to keep the system updated throughout the stores? If yes, launch with the current feedback level. Then you can improve the same based on further feedback.
If the regular change is not ...
- 313
1
vote
Should I do a redesign as part of hiring process?
I don't know about the ethicalness, but I see the same red flags you do. They're asking you to do free work for them with no guarantee of them offering you the job, and it appears the job isn't even a ...
- 9,054
1
vote
Evaluate web application mockups
As you said yourself individual user testing would be better.
Focus groups tend to be more about what the users want from the system and less about how users actually interact with the system.
...
- 1,751
1
vote
How to perform user interviews for a new product when there are IP restrictions
+1 on using an independent researcher to front for your company if you don't want participants to make assumptions about your product plans.
Also, I realize your example interview question may not be ...
1
vote
Interview brief wording advice
They're asking you to wireframe the site and show where you would put a registration link, whether that's a menu item or a tab that persists across the site but doesn't interfere with its use.
Look ...
- 6,324
1
vote
How would identify the fake participant(s) when you conduct individual interviews?
Generally the agencies that recruit on your behalf would rely on you to provide the criteria for selecting/screening participants, so the onus is really to make sure that you provide tasks that will ...
- 27.7k
1
vote
Coming up with questions for user research
Start with your objective. What do you need to learn to find success? Is it about whether people have a need for such a solution? Or for a solution, what they would value?
Once you identify what you ...
- 41
Only top scored, non community-wiki answers of a minimum length are eligible