Tag Info

Hot answers tagged

9

In general, SUS seems to be okay for web sites. Tullis and Stetson compared it with other usability surveys in assessing a corporate intranet, and SUS outperformed the others. It sounds like a couple certain individual items may not be applicable for your work. To check for this systematically, create a correlation matrix of your item responses and ...


7

The System Usability Scale is mainly intended for a comparison between like systems. It's very general to allow it to compare systems, and it gives an easy reference point. It's generally assumed that the products you are comparing have similar use cases, which mitigates the problem of some questions not applying. Comparing mortgage payment sites the ...


7

Comparing usability between systems (or within different versions of the same system) is explicitly the point of the System Usability Scale. The point of SUS scores is that they're fairly vague, and since you're supposed to be comparing generally similar systems (why would you be comparing dissimilar systems?), they can be a quick and dirty way to get some ...


5

A success rate is one of many metrics used for measuring/quantifying usability. As http://www.measuringusability.com/blog/essential-metrics.php describes, if a task can not be completed, the product is not usable. "If users cannot accomplish their goals, not much else matters." The methods used for determine success rate will vary greatly depending upon: ...


5

I looked for one myself some time ago and couldn't find anything. The thing is that the SUS was released as a free “quick and dirty” scale and nobody “owns” it in the way the Human Factors Research Group at UCC controls the SUMI. Perhaps more importantly, there are now quite some published data on the English-language version of the SUS and its ...


4

The take-home I get from Bangor, Kortun, & Miller (2009) that you cite in your comment is that there’s not much difference at least in the categories they used –all averaged in the 66-76 range, while individual product scores ranged from 30 to 94. With the quartile scores Bangor et al provide, you can convert a score you have into a percentile by making ...


4

In this type of questionnaires, the statements (called “items” in the technical literature) are not chosen mainly because they describe what usability is but because they are affected by it (i.e. the question is not “how does this affect usability” but “how does usability affect this”) and the ratings are correlated together. For the SUS, they were ...


4

For me it's a swings and roundabouts discussion. Each has some advantages and disadvantages. Here are some pointers to some research / background that should help you decide between them: A comparison of current approaches to usability measurement. SUS: A Retrospective A Comparison of Questionnaires for Assessing Website Usability (and if you go for SUS ...


3

You need to set your business goals and based on that you can set you ways to measure the success. Think about an e-commerce site, or think about a social network. The goals of the business will be completely different, i.e. % abandoned baskets, conversion, etc. Tools like Google analytics help to make sure you are able to constantly monitor the site and ...


2

I just looked at http://isitjustme.de/2012/01/crowdsourcing-the-translation-of-sus/ users user13154 recommandation. It seems that the effort was picked up by SAP and there is a professionally translated and verifyied version at http://www.sapdesignguild.org/resources/sus.asp


2

You can find the version that we use here: http://minds.coremedia.com/2013/09/18/sus-scale-an-improved-german-translation-questionnaire/ In the development of the German version of the scale, we analyzed and included the other sources mentioned in earlier posts and eliminated a problem with one item. The scale was used with > 80 participants, without any ...


2

Building on Jørn's answer: statistical analyses can help you compare a small group of high-quality users with the rest. Which tests are most appropriate will depend on your sample size and on the asssumptions you can safely make about the nature of your data (such as normally distributed, equal variances, etc.). To compare the scores of two groups on the ...


2

On the contrary, all research emphasized how important it is to use the actual user group in your test and not the contractor or leadership. Despite this, I believe that your planned studies are better than nothing. Every usability specialist has some kind of "quick and dirty testing"-advice or "do it yourself"-advice. And these advices do usually include ...


2

You can have several levels of "success rate", but in essence it's a matter of saying "yes" or "no" to this question: "Did the user accomplich the task?" Quote from the book, p65: To measure task success, each task [...] must have a clear end-state. It's similar to "effectiveness" in the ISO 9241-11 definition...


2

Both printed and digital documents can be evaluated for usability, in the sense that you can define metrics that gauge just how easy it is to use the document. There are also overlaps between the use of colour/contrast, typography and information architecture that are relevant, although you have to adjust it for the type of content, which is a static ...


2

System Usability Scale questions I think that I would like to use this system frequently. I found the system unnecessarily complex. I thought the system was easy to use. I think that I would need the support of a technical person to be able to use this system. I found the various functions in this system were well integrated. I thought ...


1

@Jayfang : I think that I would like to use eBill frequently to verify my expenses. I found this eBill unnecessarily complex. I thought this eBill was easy to use. I think that I would need professional support to use this eBill in order to verify my expenses (analyze). I found the various parts in this eBill were well integrated. I thought there was too ...


1

SUS has been shown to work well with isolated parts of the system - i.e. you can re-define the "system" being surveyed as "the eBill". However if the phrasing of a question causes significant doubt about a valid answer, then that is likely to skew the results. So take look at the questions individually I think that I would like to use this system ...



Only top voted, non community-wiki answers of a minimum length are eligible