5
votes
How many users do I need to run a SUS and get valid result?
Measuring Usability has an article that briefly touches on sample size. TL;DR: 2 is the obvious minimum, 5 is a suitable starting point.
From 10 Things To Know About The System Usability Scale (SUS):
...
- 17.6k
5
votes
Accepted
How many participants for a survey when you don't know the total population?
About 400 people. Sample size is more influenced by your confidence level and margin of error than the population size.
If your confidence level is 95% and your margin for error ±5% your sample size ...
- 8,868
4
votes
Confidence intervals, Confidence levels and probability of simple tests
From your example, let's imagine you have run the fake door test, which resulted in 265 visitors clicking on it, where total visitors that day were 350.
The real question (as you rightfully ...
4
votes
User research and testing compared to ACSI (American Customer Satisfaction Index)
Short answer is they compliment each other, but ACSI is not about usability, although the usability of something could influence the ACSI score, but I doubt anyone has found a correlation.
There is ...
- 8,904
4
votes
Accepted
How to analyse results for an open ended question?
Text Mining
Some researchers have calculated word frequencies, but raw frequencies by themselves are not very reliable or informative. For example, if 40% of your users used the word “helpful,” you ...
- 37.7k
3
votes
Equivalent Scale in UX like the Cooper-Harper Scale?
Yes, there are modified Cooper-Harper Scales that measure operator workload. It involves some basic tweaking from "pilot" to "operator".
Here is one such representation of the Modified Cooper-Harper ...
- 17.6k
2
votes
how to get the conversion rate of a certain goal on google analytics?
This question feels off-topic according to the help center's guidelines: https://ux.stackexchange.com/help/on-topic
For specific information on goals and how to track them, see the help topic about ...
- 56
2
votes
Does using part of a usability questionnaire diminish its validity?
It depends on how the questionnaire was created. Many questionnaires are just thrown together and you can do whatever you like to them - as many people who have used SUS have shown. SUS is like a raft:...
- 81
2
votes
Quantifying Simplified Language
we'd like to know how much time would it save them not to have to figure out the harder text
If time is your key metric just report on that dimension (time) somehow. I've never done it myself with ...
- 1,537
2
votes
User interface design comparison test
You would be able to compare the two by making a prototype of the existing site.
This prototype (of the existing site) should be presented with the same tool and have the same level of detail.
You ...
- 6,641
2
votes
Accepted
Simple way to determine the percent of various screen real estate commitments in competition?
As far as I am aware there is no quick and easy tool to do this for a bunch of pages - just patience and mathematics
Grand a screenshot of the page you want to analyse.
Calculate the full area in ...
- 14.2k
2
votes
How is design debt measured or calculated?
Based on the effort and process required in the design phases of UX projects, I would suggest that a simple way to estimate the amount of design debt can be calculated as follows:
Human resources
...
- 26.5k
2
votes
How is design debt measured or calculated?
I hope your question will be strictly answered from a UX position, although i'm a bit skeptical as technical debt is barely popular in the tech side.
I have found a paper named
An Analysis of ...
- 2,445
2
votes
When do you choose quantitative research over qualitative research?
Qualitative research is good to use at the beginning stages of product development (Interviews i.e.) because you want to gain insights in pain points from the user, that your product can ideally solve....
- 2,656
2
votes
Quantifying the impact of offering alternative signup/login methods?
I wouldn't have normally responded on this, but you said "any information is a massive improvement." While I can't speak to signup conversion rates, I can speak to an angle which you may ...
2
votes
Can we use A/B testing for analyze new features?
Yes. This is done in the industry, often as a rollout plan when releasing a new design of a major feature.
For example the new design of the feature will be revealed to 10% of the audience for 2 weeks,...
- 10.6k
1
vote
Is there any value in a post user testing questionnaire considering the sample sizes being small?
is there any value in this approach?
Short answer: YES*
*conditions apply
The Nielsen Norman Group, which is always a great source for research-based guidelines, states that in most cases 5 users are ...
- 1,355
1
vote
What process should be undertaken to get feedback from white-label clients?
My suggestion is rating feature where possible to display to gain feedback about overall UX. Once I used sticky smile face on the left corner of the footer to pop-up but main idea was showing a 3 ...
- 1,722
1
vote
Usability testing analysis
Not quite sure if this is what you're asking, but if I were looking to analyse usability testing quantitatively I'd be considering things like:
Task completion rate %
Direct / indirect completion (...
- 2,054
1
vote
Confidence intervals, Confidence levels and probability of simple tests
The test that you described is not a true experiment or test.
The hypothesis is unclear, the results cannot be reproduced or generalized. The method is more of a user survey, so there's no point in ...
- 1,402
1
vote
How to identify patterns from users survey comments
There are many methods, and choosing one depends upon what type of research you are doing. Specifically how precise and valid does your findings have to be.
In qualititave research grounded theory ...
- 431
1
vote
SUS evaluation on the same system but different sections and participants
Depends on the system, but quite unlikely.
SUS has an unique way to measure questions, so you can't just combine results and take averages. Also, it's recommended to measure only one task at the ...
- 36.6k
1
vote
What questions to ask in user interview to create better empathy map?
Question: What method do you intend to use? Will you be doing face-to-face interviews or observations in context?
Adding observation is key because you can actually watch people trying to accomplish ...
- 41
1
vote
How is design debt measured or calculated?
An Example
Overview
I worked on a website where my goal was to increase conversions in an registration process. There was an input field that I wanted to alter "Date Picker" as my analytics ...
- 589
1
vote
How many users for a Beta product?
There is not a certain number of testers. You must determine the goals of your analysis. Also you must determine the planned number of users of your product. After that you can understand what types ...
- 11
1
vote
Accepted
How many users for a Beta product?
Why are you talking hard numbers ?
The whole point of the Beta program is to get users to test a new version, you want them to test the program extensively and report any issues. Ideally, you would ...
- 126
1
vote
How many users for a Beta product?
It depends on what kind of research questions you have and what kind of data you want to collect.
The Qualtrics tool is great for any kind of quantitative analysis. Think of the margin of error as a ...
- 1,549
1
vote
Quantifying Simplified Language
There are a number of different readability tests, depending on what you think is the best measure for your purposes. Most of them are structured around length of sentences, density of text and the ...
- 26.5k
1
vote
Accepted
Quantitative testing on other peoples websites
I have my own method to obtain quantitative data from other sites, it might not be exactly what you are looking for, but it might help.
Basically, my method relies on extracting data from the sites I ...
- 987
1
vote
Accepted
User Test with Task Scenarios That Have Unachievable Goals?
Let's say after doing user research I come up with task scenarios (based on real needs) that include goals which can't be achieved with the current tool. How does one proceed in that case?
Assuming ...
- 1,537
Only top scored, non community-wiki answers of a minimum length are eligible