Questions tagged [quantitative-analysis]
The quantitative-analysis tag has no usage guidance.
50
questions
0
votes
2
answers
54
views
Asking post task questions
I was looking online to understand what is the best format for post task questions. After each task (There are only two tasks) I want to ask the participant three questions, "How satisfied with ...
- 309
1
vote
2
answers
67
views
Obtaining metrics to prove your designs will improve the UX
Say you were asked to improve the UX of an already existing feature, and you wanted to provide some kind of proof and metrics how is this approach.
A 'talk out loud' user test (6 participants) giving ...
4
votes
3
answers
150
views
How many participants for a survey when you don't know the total population?
I have been using a sample size calculator to know how many participants I should have to have a sample and results that are representative for my total population. But what if we don't know the total ...
- 523
5
votes
2
answers
150
views
How to analyse results for an open ended question?
I asked an open-ended question in a survey about one of our app's features (That is somewhat similar to its search feature) to find out why users would use this instead of search. I've got a large ...
- 10.6k
4
votes
1
answer
73
views
Can we use A/B testing for analyze new features?
Hello I'm quite newbie in UX, especially in A/B Testing methods.
In my opinion and after I read some of articles. A/B testing usually used for analyze some new call to action button, copywriting, ...
1
vote
1
answer
68
views
Quantifying the impact of offering alternative signup/login methods?
Nowadays it's common for websites to offer signup/signin methods that don't require making an account (email/password) for that specific site, for example 'Login with x':
Facebook
Google
Twitter
...
- 289
1
vote
2
answers
90
views
Is there any value in a post user testing questionnaire considering the sample sizes being small?
I worked at company that after user testing sessions got users to complete a post testing questionnaire. The questionnaire tended to ask user for an NPS score, answer SUS (usability) questions and the ...
- 11
-1
votes
3
answers
68
views
Is Triangulation both qualitative and quantitive?
Quick question: Is Triangulation both qualitative and quantitive?
3
votes
3
answers
192
views
When do you choose quantitative research over qualitative research?
I want to know some of the discerning factors of a product that makes you choose quantitative over qualitative research and vise versa at any given time during a project.?
Please elaborate when and ...
- 195
0
votes
1
answer
94
views
What process should be undertaken to get feedback from white-label clients?
I'm currently working with a company that distrbutes their white-label product and I was wondering what is the best process in order to get feedback from clients in regards to how their customers are ...
0
votes
3
answers
137
views
Usability testing analysis
I've seen some researchers "behavioural analysis matrix" when analysing user testing sessions, they have participants at the top and tasks at the bottom and simply tick yes/no if participants complete ...
- 29
4
votes
2
answers
83
views
Confidence intervals, Confidence levels and probability of simple tests
It seems to be a simple problem, but i cant figure it out
Lets say, I would like to know if there is some point to implement new feature. If we have to focus on the feature or not. Lets assume there ...
- 141
1
vote
1
answer
98
views
Why Conversion Rate + Abandonment Rate doesn't equal 100%?
I have created a funnel in google analytics with conversion rate 2.96% and abandonment rate 92.66% (Sum 95.62%). I would expect their sum to be 100%, do I miss something?
- 143
2
votes
2
answers
248
views
How to identify patterns from users survey comments
I have conducted an online survey where 1500 users participated. They have their opinions and comments about particular problems. I am trying to consolidate all their opinions & pulling out ...
- 119
1
vote
1
answer
143
views
SUS evaluation on the same system but different sections and participants
Would it be okay to use 2 SUS scores to come up with a single score in the case I explain below:
I conducted a user testing for a banking mobile app, the app under investigation has lots of tasks ...
- 93
0
votes
1
answer
3k
views
What questions to ask in user interview to create better empathy map?
After an exhausted research in the topic of Empathy Map, I understand the critical parts of the most famous maps like 4 quadrants, and Xplaner(gamestorming book) v 1.0 and 2.0 types.
They are met on ...
- 53
3
votes
3
answers
542
views
How is design debt measured or calculated?
I think designers can probably relate to 'design debt' in the same way that developers relate to 'tech debt', and there are even examples of UX debt which is probably some combination of the cost ...
- 26.1k
0
votes
3
answers
205
views
How many users for a Beta product?
We are going to present the option to try the Beta version of our product to a sample population but we don't know how to calculate to how many of our users should we release it? Should I use the same ...
- 523
0
votes
2
answers
217
views
User interface design comparison test
I need to elicit quantifiable responses to two designs. One is the live design, the other is a prototype, so I cannot evaluate directly via usability or ease of use. It has to be via Q and A. Anyone ...
1
vote
1
answer
95
views
Simple way to determine the percent of various screen real estate commitments in competition?
In short, I want to analyse a number of web pages, let's say, specifically homepages of Vox and HBR (but also a dozen others).
1) I want to figure out how much screen real estate they're giving to ...
- 123
1
vote
2
answers
55
views
Quantifying Simplified Language
If you wanted to be able to quantify how much easier it is for users when you reduce the reading level of you text, how might you do that?
For example, how would you figure out how much longer it ...
- 11
0
votes
3
answers
104
views
Quantitative testing on other peoples websites
I want to test other peoples sites, but I want to collect quantitative data, as opposed to qualitative data. For example, I'd like to test the time it takes a user to navigate to a product page once ...
- 55
0
votes
1
answer
89
views
User Test with Task Scenarios That Have Unachievable Goals?
I intend to do quantitative user tests of an existing tool and compare its usability performance to a new design that I'd propose.
Let's say after doing user research I come up with task scenarios (...
1
vote
1
answer
31
views
how to get the conversion rate of a certain goal on google analytics? [closed]
I would like to know the current conversion rate and the expected conversion rate to use them on tools like VWO or optimize by google
- 159
1
vote
1
answer
73
views
Does using part of a usability questionnaire diminish its validity?
I'm interested in using QUIS (http://garyperlman.com/quest/quest.cgi) but the questions about system capabilities are irrelevant for my purposes as well as the questions about screens. I'm primarily ...
- 111
0
votes
1
answer
115
views
What's the best strategy for tracking events using Google Analytics?
We have a web-based enterprise analytics application, with many potential user interactions spread across many different reports. Thus we have potentially hundreds of trackable events.
We are ...
- 2,537
4
votes
1
answer
3k
views
How many users do I need to run a SUS and get valid result?
I ran a System Usability Scale survey on my team (7 people) but I'm not sure that's enough to get relevant result and I didn't find any article recommending anything about the number of people to ...
- 2,562
3
votes
1
answer
62
views
Best Way to Time Users Performing Physical Activities With Mobile Application?
I work in enterprise UX and need to measure metrics for how the usability of our future application will have improved work performance among users. The system the users use today does not record a ...
4
votes
1
answer
328
views
User research and testing compared to ACSI (American Customer Satisfaction Index)
I came across through another UXSE question the idea of customer satisfaction index used in businesses as a means to improve products and services. It seems that the gold standard is the American ...
- 26.1k
2
votes
2
answers
363
views
Equivalent Scale in UX like the Cooper-Harper Scale?
Is there an equivalent scale in UX as the Cooper-Harper Scale or the Cooper-Harper Ratings are in Handling Qualities Engineering in Aerospace? The Cooper-Harper scale associates a quantitative value ...
- 121
3
votes
2
answers
375
views
Transforming coded qualitative data into a Likert scale
I'm analyzing a survey, and the requirements of the assignment are to transform the textual responses to a Likert scale. I've used grounded analysis to code the data, but now I'm not sure how to go ...
7
votes
1
answer
1k
views
Is there an updated Keystroke-level model for touch devices?
The Keystroke-level model was developed over the years to allow us to predict task times of a given set of interaction. Using this measurement is fantastic when brainstorming up potential UI solutions....
4
votes
1
answer
432
views
Enterprise UX - Proving Improvement through Quantified Data?
I am working in an organization where I am focusing on improving the usability of enterprise applications (HR applications and other applications people are forced to use in order to complete their ...
- 211
1
vote
2
answers
152
views
What's a good approach to analyze a lot of answers to a survey with open questions?
We asked our users what's their main goal of current visit (open question). We received a lot of answers and I'm wondering what would be the best approach to analyze this data. In theory I could ...
- 111
0
votes
2
answers
736
views
Using SUS to measure usability of an existing system and compare with a redesigned system
I will be undertaking a whole-scale redesign of an existing system. I'd like to use SUS ("System usability scale") questionnaires to measure improvements between iterations.
As a baseline, I want to ...
- 101
2
votes
1
answer
72
views
Visualisation of 10-12 star-based-items in a review site
I need to create a page with 10 or 12 items. Each item is a criteria for review that can be voted by the user between 1 and 4 stars. But, the problem is that it is a really strange visualisation to ...
0
votes
2
answers
7k
views
Transforming qualitative and quantitative data or methods
I can see how a large number of interviews and video can be compiled and analysed numerically (i.e. turning qualitative research into quantitative research), but is it not possible to turn ...
- 26.1k
4
votes
2
answers
505
views
Should different users always be used for successive System Usability Scale testing?
A given project requires SUS scores for the current version of a piece of software, as well as the next version when it is prepared, to allow quantitative results to demonstrate any usability ...
- 528
3
votes
4
answers
55k
views
Definition and example to distinguish qualitative and quantitative research
I am looking for the best definition for qualitative and quantitative research. I wrote an article on UX Magazine in which I tried to address the need for doing research that tries to map what happens ...
- 26.1k
4
votes
4
answers
5k
views
Quantitative and qualitative data used in UX research
I am trying to find examples of user behaviour research that combines both quantitative and qualitative data. It seems to me that most of the research leans heavily or exclusively towards one approach ...
- 26.1k
24
votes
8
answers
2k
views
Quantifiable benefits of wireframing and prototyping?
I'm trying to come up with a few sources for quantifiable benefits of wireframing and prototyping, but I am having trouble finding results. I've seen plenty of "reduces requirements phase, ...
- 2,454
4
votes
2
answers
297
views
Quantitative Analysis of Cardsort Data
I'm working on some quantitative analysis procedures for cardsort (rank-ordering) type data. Are there established best practices for something like this? I was thinking cluster analysis, logit ...
- 145
1
vote
2
answers
170
views
How to utilize analytics for mobile consideration
The company I work for has about 15% of their users/prospective members coming from a Mobile non/desktop device. Though that is not a high number, it is still a decent number. The data is collected ...
- 828
9
votes
4
answers
565
views
How to evaluate an interface without users?
I need to evaluate my application's novel interface. However, due to IRB issues I can not involve users for this stage of the evaluation. Previously, I asked How to quantitatively compare two ...
- 915
1
vote
1
answer
757
views
Looking for best practice, articles, tests or studies on video placement on websites.
We are a publisher of many special interest (that doesn't mean x-rated! ;) news websites (tech, music, sport etc). The majority of our content is editorial but we obviously have a growing amount of ...
- 111
8
votes
2
answers
1k
views
How to quantitatively compare two interfaces?
I am in the process of building a tool to make some tasks easier than an existing application allows. Right now I am surveying users and receiving feedback but I want hard numbers.
The only ...
- 915
19
votes
7
answers
1k
views
How to measure phone number views without annoying the user?
I'm working on a website where we have customer pages on which we measure user interactions such as opening a booking form or posting a review.
One of the interactions we want to measure is when the ...
- 291
17
votes
5
answers
2k
views
How is a cluttered layout quantified?
In the comments of a different question, I asserted that Visual Studio has a "cluttered" layout. A different user disagreed with my assertion, and it made me curious as to how to quantify a cluttered ...
- 2,979
6
votes
3
answers
506
views
Quantitative methods for analysing vast Intranet IA
I have been asked to analyse and better group pages under a section of a large government website. The number of pages runs into the thousands.
The problems I have is that metadata rules have not ...
- 8,250
9
votes
4
answers
376
views
What's recommended for the number of users to use in qualitative and quantitative testing?
I'm currently rebuilding our entire intranet from scratch, mostly because the tech behind is out-dated and it has been proved that a lot of information is difficult to find.
Though that is beside the ...
- 248