5 votes

How many users do I need to run a SUS and get valid result?

Measuring Usability has an article that briefly touches on sample size. TL;DR: 2 is the obvious minimum, 5 is a suitable starting point. From 10 Things To Know About The System Usability Scale (SUS): ...
Nicholas Pappas's user avatar
5 votes
Accepted

How many participants for a survey when you don't know the total population?

About 400 people. Sample size is more influenced by your confidence level and margin of error than the population size. If your confidence level is 95% and your margin for error ±5% your sample size ...
Nathan Rabe's user avatar
  • 8,888
4 votes

Confidence intervals, Confidence levels and probability of simple tests

From your example, let's imagine you have run the fake door test, which resulted in 265 visitors clicking on it, where total visitors that day were 350.

 The real question (as you rightfully ...
Steven B. Peutz's user avatar
4 votes

User research and testing compared to ACSI (American Customer Satisfaction Index)

Short answer is they compliment each other, but ACSI is not about usability, although the usability of something could influence the ACSI score, but I doubt anyone has found a correlation. There is ...
SteveD's user avatar
  • 8,914
4 votes
Accepted

How to analyse results for an open ended question?

Text Mining Some researchers have calculated word frequencies, but raw frequencies by themselves are not very reliable or informative. For example, if 40% of your users used the word “helpful,” you ...
Michael Zuschlag's user avatar
3 votes

Equivalent Scale in UX like the Cooper-Harper Scale?

Yes, there are modified Cooper-Harper Scales that measure operator workload. It involves some basic tweaking from "pilot" to "operator". Here is one such representation of the Modified Cooper-Harper ...
Nicholas Pappas's user avatar
2 votes

how to get the conversion rate of a certain goal on google analytics?

This question feels off-topic according to the help center's guidelines: https://ux.stackexchange.com/help/on-topic For specific information on goals and how to track them, see the help topic about ...
IanA's user avatar
  • 56
2 votes

Does using part of a usability questionnaire diminish its validity?

It depends on how the questionnaire was created. Many questionnaires are just thrown together and you can do whatever you like to them - as many people who have used SUS have shown. SUS is like a raft:...
Jurek's user avatar
  • 81
2 votes

Quantifying Simplified Language

we'd like to know how much time would it save them not to have to figure out the harder text If time is your key metric just report on that dimension (time) somehow. I've never done it myself with ...
Luke Smith's user avatar
  • 1,537
2 votes

User interface design comparison test

You would be able to compare the two by making a prototype of the existing site. This prototype (of the existing site) should be presented with the same tool and have the same level of detail. You ...
Mayo's user avatar
  • 6,641
2 votes
Accepted

Simple way to determine the percent of various screen real estate commitments in competition?

As far as I am aware there is no quick and easy tool to do this for a bunch of pages - just patience and mathematics Grand a screenshot of the page you want to analyse. Calculate the full area in ...
Roux Martin's user avatar
  • 14.2k
2 votes

How is design debt measured or calculated?

Based on the effort and process required in the design phases of UX projects, I would suggest that a simple way to estimate the amount of design debt can be calculated as follows: Human resources ...
Michael Lai's user avatar
  • 27.1k
2 votes

How is design debt measured or calculated?

I hope your question will be strictly answered from a UX position, although i'm a bit skeptical as technical debt is barely popular in the tech side. I have found a paper named An Analysis of ...
UX Labs's user avatar
  • 2,455
2 votes

When do you choose quantitative research over qualitative research?

Qualitative research is good to use at the beginning stages of product development (Interviews i.e.) because you want to gain insights in pain points from the user, that your product can ideally solve....
xul's user avatar
  • 2,676
2 votes

Quantifying the impact of offering alternative signup/login methods?

I wouldn't have normally responded on this, but you said "any information is a massive improvement." While I can't speak to signup conversion rates, I can speak to an angle which you may ...
Jason Holtzen's user avatar
2 votes

Can we use A/B testing for analyze new features?

Yes. This is done in the industry, often as a rollout plan when releasing a new design of a major feature. For example the new design of the feature will be revealed to 10% of the audience for 2 weeks,...
Blue Ocean's user avatar
  • 10.7k
1 vote

Is there any value in a post user testing questionnaire considering the sample sizes being small?

is there any value in this approach? Short answer: YES* *conditions apply The Nielsen Norman Group, which is always a great source for research-based guidelines, states that in most cases 5 users are ...
QWERTZdenker's user avatar
  • 1,355
1 vote

What process should be undertaken to get feedback from white-label clients?

My suggestion is rating feature where possible to display to gain feedback about overall UX. Once I used sticky smile face on the left corner of the footer to pop-up but main idea was showing a 3 ...
Erhan Yaşar's user avatar
  • 1,758
1 vote

Usability testing analysis

Not quite sure if this is what you're asking, but if I were looking to analyse usability testing quantitatively I'd be considering things like: Task completion rate % Direct / indirect completion (...
dougajmcdonald's user avatar
1 vote

Confidence intervals, Confidence levels and probability of simple tests

The test that you described is not a true experiment or test. The hypothesis is unclear, the results cannot be reproduced or generalized. The method is more of a user survey, so there's no point in ...
Ling's user avatar
  • 1,402
1 vote

How to identify patterns from users survey comments

There are many methods, and choosing one depends upon what type of research you are doing. Specifically how precise and valid does your findings have to be. In qualititave research grounded theory ...
simonlh's user avatar
  • 431
1 vote

SUS evaluation on the same system but different sections and participants

Depends on the system, but quite unlikely. SUS has an unique way to measure questions, so you can't just combine results and take averages. Also, it's recommended to measure only one task at the ...
Devin's user avatar
  • 38k
1 vote

What questions to ask in user interview to create better empathy map?

Question: What method do you intend to use? Will you be doing face-to-face interviews or observations in context? Adding observation is key because you can actually watch people trying to accomplish ...
RPJ's user avatar
  • 41
1 vote

How is design debt measured or calculated?

An Example Overview I worked on a website where my goal was to increase conversions in an registration process. There was an input field that I wanted to alter "Date Picker" as my analytics ...
Bromox's user avatar
  • 589
1 vote

How many users for a Beta product?

There is not a certain number of testers. You must determine the goals of your analysis. Also you must determine the planned number of users of your product. After that you can understand what types ...
Jude Carter's user avatar
1 vote
Accepted

How many users for a Beta product?

Why are you talking hard numbers ? The whole point of the Beta program is to get users to test a new version, you want them to test the program extensively and report any issues. Ideally, you would ...
thecarpy's user avatar
  • 126
1 vote

How many users for a Beta product?

It depends on what kind of research questions you have and what kind of data you want to collect. The Qualtrics tool is great for any kind of quantitative analysis. Think of the margin of error as a ...
celinelenoble's user avatar
1 vote

Quantifying Simplified Language

There are a number of different readability tests, depending on what you think is the best measure for your purposes. Most of them are structured around length of sentences, density of text and the ...
Michael Lai's user avatar
  • 27.1k
1 vote
Accepted

Quantitative testing on other peoples websites

I have my own method to obtain quantitative data from other sites, it might not be exactly what you are looking for, but it might help. Basically, my method relies on extracting data from the sites I ...
ghislaineguerin's user avatar
1 vote
Accepted

User Test with Task Scenarios That Have Unachievable Goals?

Let's say after doing user research I come up with task scenarios (based on real needs) that include goals which can't be achieved with the current tool. How does one proceed in that case? Assuming ...
Luke Smith's user avatar
  • 1,537

Only top scored, non community-wiki answers of a minimum length are eligible