20
votes
Accepted
What to do if SUS scores contradict qualitative feedback?
How can this discrepancy be reconciled?
You have divergent results because the number of participants is small and not representative. There is no randomization or blinding to prevent bias. You're ...
13
votes
How to extract more insightful UX requirements from User
Resolve the behavioral stumbling block
You make a key observation that it's hard to get users to backtrack from a specific suggestion ("I want this button!") that they are psychologically anchored on....
11
votes
What to do if SUS scores contradict qualitative feedback?
How to reconcile the discrepancy? That I can't tell but here is why it might have happened.
The "5 users will find everything wrong with your system" refers to usability problems test subjects will ...
9
votes
How to extract more insightful UX requirements from User
This won't fully answer your question since you already included part of the answer in your question :)
For the part where the user (or the client in some cases) insists on "But I WANT a BUTTON", I ...
9
votes
Accepted
How to extract more insightful UX requirements from User
I've tried to solve this same question in the past. Here's my solution.
Keep it short. Direct them to activities.
Focus the issue with a choice:
"I'm trying to do something that's not currently ...
7
votes
What to do if SUS scores contradict qualitative feedback?
Look at your confidence intervals: the "real" score for v1 is somewhere between 58 and 88, while that score for v2 is somewhere between 51 and 79. Most notably, the confidence interval for each score ...
3
votes
Is asking 'balanced' leading questions the right way during user interviews?
Asking closed questions is not optimal, for the reasons pointed out by Kristian - they skew the results. I think Adrian has a point too, since getting feature-specific feedback might be a better fit ...
3
votes
Quick, Quantifiable UX Screener Questions
Simple Heuristic Evaluation
Show some simple interfaces, give them a copy of Neilsen's 10 Usability Heuristics, and ask to identify usability issues and which heuristics are violated.
The HR rep ...
3
votes
What research method is appropiate for this case?
User research is quantitative/qualitative and attitudinal/behavioural . The decision of when to use which UX research method depends on your product stage as well as the factors listed by you. As you ...
3
votes
What are you looking for in design interviews?
I try to ask as much about what the user does instead of what the user might want. For instance, if I'm trying to improve a user's workflow, I'll ask:
clarify what the user is trying to accomplish
...
3
votes
Accepted
How to coach reviewers past saying a design is "clean"?
I read an article once that made an interesting point. I'm sorry, I was 90% sure it was on smashing, but I couldn't find it. However, the takeaway for me was to set ground rules before starting a ...
3
votes
Best practices for performing prototyping tasks in interviews, e.g. whether to explain with notes?
Speaking as somebody who occasionally sits on the interviewing side of the table I would not care at all what tool you chose to use. Balsamiq. Sketches on paper. Keynote. Whatever.
What I would care ...
3
votes
Accepted
How to perform user interviews for a new product when there are IP restrictions
The question "Due to the actual cost of gas, would you like your car to run on a cheaper kind of energy rather than gas?" will not , on it's own, cause any kind of intellectual property issues. It ...
3
votes
How do you uncover true motivations and goals during user research?
I think there's something here to be said for not asking 'why' and trying to understand their true rationale deeper. In a workplace context their entire rationale possible is that, and knowing why won'...
2
votes
Accepted
Best practices for performing prototyping tasks in interviews, e.g. whether to explain with notes?
Honestly, it depends on if it's UI or UX. Interfaces are going to be more visual, and may require you to produce a more mid-fidelity prototype such as you would on Balsamiq, Moqups, or Froont.
On the ...
2
votes
Accepted
Observing and finding bottlenecks of a process
How to observe different roles
"An installation job usually has around 2-3 people working on different jobs (roof crew does installations, ground crew does prep work, etc). How would one conduct a CI ...
2
votes
Accepted
Avoiding negative or positive biases during interviews
First off, let's assess what you're trying to do.
The subject of this research is old (maybe obsolete) software. What you're looking for in this software is answers to "what patterns to drop", and "...
2
votes
How to extract more insightful UX requirements from User
I'm sure this is going to upset several people but here it goes.
I personally believe that this is not a user issue. A user is not going to have insightful UX requirements and this is the reason that ...
2
votes
How to extract more insightful UX requirements from User
There's two issues here to address: getting a proper understanding of what the suggested change is supposed to accomplish, and avoiding resistance or frustration from the customer because "why are you ...
2
votes
What research method is appropiate for this case?
(Just adding to Adit's plan) You have a lot of users, and that's gold . If there's also a strong community behind the app or game you are working on, or you would want to build one, products like ...
2
votes
what kind of questions should i ask the user during the user interview to get insights for revamping website on-boarding?
UX pros mistrust surveys since survey answers are unreliable. People tend to mis-remember things and provide answers that are not-quite accurate. (Not that people lie on surveys. We all tell certain ...
2
votes
Is asking 'balanced' leading questions the right way during user interviews?
One approach that can be useful for getting a meaningful response is to ask the user to place their response on a sliding scale between two options that have the same level of "goodness" or "badness", ...
2
votes
Is asking 'balanced' leading questions the right way during user interviews?
When you ask leading question you are biasing the responses because you "prime" the users to answer you in a particular direction. When you ask "Is clicking on this button difficult for you to ...
2
votes
Test to evaluate a UX designer in product company
Often times it's not advised to have a design candidate solve an actual problem your company is trying to solve. This can be seen as spec work, which in the industry, is considered a no-no. Instead, ...
2
votes
Interviewing a Single User About an Existing UI Improvements
One person's feedback will not be determinative, because this user can be an outlier. Depending on the complexity of the application you might need at least 5 people to uncover most problems. That ...
2
votes
Accepted
Interview brief wording advice
Let's break this down.
...registration Call to Action "component"...that encourages registration ... [and] could be repurposed in the header, footer, middle of a page - wherever you propose
"[...
2
votes
Accepted
UX Interview Questions
"How many long have you been using [the product]?" - what do you expect this question to reveal?
"How would you rate your overall familiarity with [the product]?" - what do you expect this question ...
2
votes
Accepted
App on-boarding via contextual imagery
May I know the goal of these questionaires? are you trying to personalize the feeds base on user's choices or? You have mentioned that there will be a simple animation prior to these questions, so I ...
2
votes
Interview methods for user needs phase
Your initial approach seems like a good start. Have a look at the following resources hopefully this will give you some guidance:
Is asking 'balanced' leading questions the right way during user
...
2
votes
What to do if SUS scores contradict qualitative feedback?
I think the most important thing is to realize that using a combination of qualitative and quantitative analysis methods is going to give you the most complete best picture of what the users are ...
Only top scored, non community-wiki answers of a minimum length are eligible
Related Tags
interview × 60user-research × 21
ux-field × 7
usability × 5
design × 5
users × 5
surveys × 5
usability-testing × 4
user-centered-design × 4
jobs × 4
website-design × 3
question-answer × 3
ethnography × 3
user-behavior × 2
user-expectation × 2
research × 2
feedback × 2
psychology × 2
personas × 2
onboarding × 2
methodology × 2
career-development × 2
requirements × 2
agile × 2
intranet × 2