20
votes
Accepted
What to do if SUS scores contradict qualitative feedback?
How can this discrepancy be reconciled?
You have divergent results because the number of participants is small and not representative. There is no randomization or blinding to prevent bias. You're ...
- 1,885
11
votes
What to do if SUS scores contradict qualitative feedback?
How to reconcile the discrepancy? That I can't tell but here is why it might have happened.
The "5 users will find everything wrong with your system" refers to usability problems test subjects will ...
- 5,279
7
votes
What to do if SUS scores contradict qualitative feedback?
Look at your confidence intervals: the "real" score for v1 is somewhere between 58 and 88, while that score for v2 is somewhere between 51 and 79. Most notably, the confidence interval for each score ...
- 1,875
5
votes
How many users do I need to run a SUS and get valid result?
Measuring Usability has an article that briefly touches on sample size. TL;DR: 2 is the obvious minimum, 5 is a suitable starting point.
From 10 Things To Know About The System Usability Scale (SUS):
...
- 17.6k
4
votes
Accepted
Measuring the user experience of Augmented reality application for elderly
Concerning the second question, Blažica & Lewis detail their method of translating SUS to Slovenian in their paper A Slovene Translation of the System Usability Scale: The SUS-SI. They use method ...
- 5,279
4
votes
System Usability Scale in Spanish/other languages?
This small study suggests that the quality of translation is important, especially for question 8:
https://uxpa.org/sites/default/files/finstad_sus_non_native_speakers.pdf
There is a crowdsourced ...
- 8,904
4
votes
How to interpret SUS learnability score?
A quick google search lead me to MeasuringU:
The average SUS Score is a 68: When looking at scores from 500 products, we found the average SUS score to be a 68. It's important to remember that SUS ...
- 8,301
3
votes
WAMMI vs SUS global score
As with any metrics or scores for the online/digital space, you have to fully understand exactly what you are comparing to make sure that you are making meaningful comparisons.
This why you normally ...
- 26.5k
3
votes
How to interpret SUS learnability score?
Recent research has brought into question whether or not it is OK to break the SUS into Learnable and Usable subscales -- for the full article, see http://uxpajournal.org/revisit-factor-structure-...
- 31
3
votes
How to check for Inconsistent Respondents in System Usability Scale (SUS)?
When analyzing survey data you need to separate validity from reliability.
Validity is a measurement of how correct the answer is.
Reliability is a measure of how consistent the answer is.
Here's a ...
- 166
2
votes
Alternatives to System Usability Scale (SUS)
Regarding the question, "In particular...is there anything which produces somewhat similarly reliable results with fewer questions?"
You should take a look at the published research on the Usability ...
- 121
2
votes
System Usability Scale and internal reliability
What pairs of questions test respondent's consistency?
They don't exist ;-)
The SUS wasn't designed with pairs of questions in mind. The SUS wasn't designed to test particular factors (although ...
- 10.3k
2
votes
Accepted
Usability measurement: Nielsen's Attributes of Usability versus the SUS
Because SUS works very well and has been examined closely practitioners for more than 25 years.
The SUS questions weren't pulled out of a hat. They were research based. To somewhat extensively quote ...
- 10.3k
2
votes
Performing a System Usability Scale test
The SUS is given to people who have used your product in some way. Your method of having them perform their task and then administer the SUS is a perfectly valid application of the SUS. It's very ...
- 3,624
2
votes
WAMMI vs SUS global score
Generally speaking no, they are not. The global UX described by the SUS may vary from the general UX described by the WAMMI. So you are basically trying to compare different things that have a similar ...
- 1,772
2
votes
Are the System Usability Scale (SUS) questions copyrighted?
The paper "SUS - A quick and dirty usability scale" has a copyright notice in it: "© Digital Equipment Corporation, 1986." This copyright notice is shown on exactly those pages where the SUS scale ...
- 129
2
votes
Accepted
Is this considered Formative or Summative Usability Study?
I see this as Summative but honestly someone could argue for either case and be correct. Should you be picking your research methods and then figuring out what type of evaluation they are? OR should ...
- 528
2
votes
SUS Questions- Infrequent Experience
With SUS, you have some room to play around with the words without effecting the results too much.
For example, you could change it to:
I think that I would like to use this service frequently.
or
...
- 7,371
2
votes
What to do if SUS scores contradict qualitative feedback?
I think the most important thing is to realize that using a combination of qualitative and quantitative analysis methods is going to give you the most complete best picture of what the users are ...
- 26.5k
2
votes
Accepted
What to report when conducting a usability testing with a small sample (5 participants)?
Five participants can uncover usability issues, but you can't report confidently with a sample size that small, so stay away from quantifying it. You can give the development team your suggestions for ...
- 12k
2
votes
What to report when conducting a usability testing with a small sample (5 participants)?
First of all you should definitely check Nielsen Norman's article named "Why You Only Need to Test with 5 Users" (link)
Basically you can use it to find usability problems or validate your ...
- 21
1
vote
Best practices for System Usability Scale (SUS) Scoring
There are a number of possible interpretations on what 'bulking up' your usability tests with SUS scores might mean, so let's look at some of them.
Given that usability tests are generally much more ...
- 26.5k
1
vote
Questionnaire for Small Sample Studies (5-7 users)
When conducting usability tests, task completion rates combined with a standard usability measurement is typically enough data for me. For the standard usability measurement, the SUS definitely works, ...
- 594
1
vote
Questionnaire for Small Sample Studies (5-7 users)
TLDR; There's a a prior question which I suggested a couple
of methodologies but the resources below has way larger alternatives.
I conducted a thesis research as well and started like writing down ...
- 1,722
1
vote
Is it valid to administer a SUS questionnaire after a system training session?
As with any research or testing method, there are aspects that may influence results which you'd need to consider.
This is just an example of one of them, you could perhaps treat the specific answer ...
- 2,054
1
vote
SUS evaluation on the same system but different sections and participants
Depends on the system, but quite unlikely.
SUS has an unique way to measure questions, so you can't just combine results and take averages. Also, it's recommended to measure only one task at the ...
- 36.6k
1
vote
Measuring the user experience of Augmented reality application for elderly
As 'locationunknown' has pointed out, SUS has a very odd factorial structure: two of its items are actually about Learnability! Yep, read them and guess which! This means that SUS has an effective ...
- 81
1
vote
Is there a median SUS score for internal-facing apps, vs customer-facing apps?
The aim of sus aka System Usability scale is to measure the usability of the system:
How ease your app is
Dose your app require technical and prior knowledge before using it.On anothe word, ...
- 421
1
vote
Performing a System Usability Scale test
You are on the right track.
In practice you:
Let people use your application doing one or more tasks that you want them to successfully complete.
Survey the people who used the application and ...
- 11
1
vote
Example SUS scores / proof of outcome?
As far as I know there are a few SUS studies (some say about 500 and original Brooke, J. (1986) paper just the first of them) proving it is reliable and very convenient (you can acquire reliable ...
Only top scored, non community-wiki answers of a minimum length are eligible