Hot answers tagged

20 votes
Accepted

What to do if SUS scores contradict qualitative feedback?

How can this discrepancy be reconciled? You have divergent results because the number of participants is small and not representative. There is no randomization or blinding to prevent bias. You're ...
習約塔's user avatar
  • 1,885
11 votes

What to do if SUS scores contradict qualitative feedback?

How to reconcile the discrepancy? That I can't tell but here is why it might have happened. The "5 users will find everything wrong with your system" refers to usability problems test subjects will ...
locationunknown's user avatar
7 votes

What to do if SUS scores contradict qualitative feedback?

Look at your confidence intervals: the "real" score for v1 is somewhere between 58 and 88, while that score for v2 is somewhere between 51 and 79. Most notably, the confidence interval for each score ...
Mark's user avatar
  • 1,875
5 votes

How many users do I need to run a SUS and get valid result?

Measuring Usability has an article that briefly touches on sample size. TL;DR: 2 is the obvious minimum, 5 is a suitable starting point. From 10 Things To Know About The System Usability Scale (SUS): ...
Nicholas Pappas's user avatar
4 votes
Accepted

Measuring the user experience of Augmented reality application for elderly

Concerning the second question, Blažica & Lewis detail their method of translating SUS to Slovenian in their paper A Slovene Translation of the System Usability Scale: The SUS-SI. They use method ...
locationunknown's user avatar
4 votes

System Usability Scale in Spanish/other languages?

This small study suggests that the quality of translation is important, especially for question 8: https://uxpa.org/sites/default/files/finstad_sus_non_native_speakers.pdf There is a crowdsourced ...
SteveD's user avatar
  • 8,924
3 votes

WAMMI vs SUS global score

As with any metrics or scores for the online/digital space, you have to fully understand exactly what you are comparing to make sure that you are making meaningful comparisons. This why you normally ...
Michael Lai's user avatar
  • 26.9k
3 votes

How to interpret SUS learnability score?

Recent research has brought into question whether or not it is OK to break the SUS into Learnable and Usable subscales -- for the full article, see http://uxpajournal.org/revisit-factor-structure-...
James Lewis's user avatar
2 votes

Alternatives to System Usability Scale (SUS)

Regarding the question, "In particular...is there anything which produces somewhat similarly reliable results with fewer questions?" You should take a look at the published research on the Usability ...
Jim Lewis's user avatar
  • 121
2 votes

Performing a System Usability Scale test

The SUS is given to people who have used your product in some way. Your method of having them perform their task and then administer the SUS is a perfectly valid application of the SUS. It's very ...
nadyne's user avatar
  • 3,624
2 votes

WAMMI vs SUS global score

Generally speaking no, they are not. The global UX described by the SUS may vary from the general UX described by the WAMMI. So you are basically trying to compare different things that have a similar ...
Marco Tatta's user avatar
  • 1,762
2 votes

Are the System Usability Scale (SUS) questions copyrighted?

The paper "SUS - A quick and dirty usability scale" has a copyright notice in it: "© Digital Equipment Corporation, 1986." This copyright notice is shown on exactly those pages where the SUS scale ...
Tanner Swett's user avatar
2 votes
Accepted

Is this considered Formative or Summative Usability Study?

I see this as Summative but honestly someone could argue for either case and be correct. Should you be picking your research methods and then figuring out what type of evaluation they are? OR should ...
It's Dylan's user avatar
2 votes

SUS Questions- Infrequent Experience

With SUS, you have some room to play around with the words without effecting the results too much. For example, you could change it to: I think that I would like to use this service frequently. or ...
RobbyReindeer's user avatar
2 votes

What to do if SUS scores contradict qualitative feedback?

I think the most important thing is to realize that using a combination of qualitative and quantitative analysis methods is going to give you the most complete best picture of what the users are ...
Michael Lai's user avatar
  • 26.9k
2 votes
Accepted

What to report when conducting a usability testing with a small sample (5 participants)?

Five participants can uncover usability issues, but you can't report confidently with a sample size that small, so stay away from quantifying it. You can give the development team your suggestions for ...
Izquierdo's user avatar
  • 12.6k
2 votes

What to report when conducting a usability testing with a small sample (5 participants)?

First of all you should definitely check Nielsen Norman's article named "Why You Only Need to Test with 5 Users" (link) Basically you can use it to find usability problems or validate your ...
Han's user avatar
  • 21
1 vote

getting permission or paying fee to use the System Usability Scale (SUS)

It's free and you don't need any permissions, just mention the methodology used in any published work. It's a bit outdated and unreliable, though. Even the page in usability.gov states that everything ...
Devin's user avatar
  • 37.9k
1 vote

How to compare the scores/scales of SUS and SUMI

How do I scientificly conclude that one product's usability is better than the other one, since both methods have different scales? You run the study again, this time using the same methodology for ...
Leo Wattenberg's user avatar
1 vote

What to report when conducting a usability testing with a small sample (5 participants)?

It can depend on context, but generally I find that small sample size testing like that is most useful while the development is in early to mid stages. So the most valuable feedback tends to be that ...
Yasser Malaika's user avatar
1 vote

Best practices for System Usability Scale (SUS) Scoring

There are a number of possible interpretations on what 'bulking up' your usability tests with SUS scores might mean, so let's look at some of them. Given that usability tests are generally much more ...
Michael Lai's user avatar
  • 26.9k
1 vote

Questionnaire for Small Sample Studies (5-7 users)

When conducting usability tests, task completion rates combined with a standard usability measurement is typically enough data for me. For the standard usability measurement, the SUS definitely works, ...
brad's user avatar
  • 594
1 vote

Questionnaire for Small Sample Studies (5-7 users)

TLDR; There's a a prior question which I suggested a couple of methodologies but the resources below has way larger alternatives. I conducted a thesis research as well and started like writing down ...
Erhan Yaşar's user avatar
  • 1,750
1 vote

Is it valid to administer a SUS questionnaire after a system training session?

As with any research or testing method, there are aspects that may influence results which you'd need to consider. This is just an example of one of them, you could perhaps treat the specific answer ...
dougajmcdonald's user avatar
1 vote

SUS evaluation on the same system but different sections and participants

Depends on the system, but quite unlikely. SUS has an unique way to measure questions, so you can't just combine results and take averages. Also, it's recommended to measure only one task at the ...
Devin's user avatar
  • 37.9k
1 vote

Measuring the user experience of Augmented reality application for elderly

As 'locationunknown' has pointed out, SUS has a very odd factorial structure: two of its items are actually about Learnability! Yep, read them and guess which! This means that SUS has an effective ...
Jurek's user avatar
  • 81
1 vote

Is there a median SUS score for internal-facing apps, vs customer-facing apps?

The aim of sus aka System Usability scale is to measure the usability of the system: How ease your app is Dose your app require technical and prior knowledge before using it.On anothe word, ...
Serag Alzentani's user avatar
1 vote

Performing a System Usability Scale test

You are on the right track. In practice you: Let people use your application doing one or more tasks that you want them to successfully complete. Survey the people who used the application and ...
pkz's user avatar
  • 11
1 vote

What is the standardized german version of the system usability scale (SUS)?

Gao, Kortum & Oswald (2020) published studies evaluating translations of the SUS in several languages. This paper also includes the first empirical validation of a German SUS translation with a ...
Jan's user avatar
  • 111

Only top scored, non community-wiki answers of a minimum length are eligible