Last call to make your voice heard! Our 2022 Developer Survey closes in less than a week. Take survey.

Questions tagged [quantitative-analysis]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
2 answers
40 views

Obtaining metrics to prove your designs will improve the UX

Say you were asked to improve the UX of an already existing feature, and you wanted to provide some kind of proof and metrics how is this approach. A 'talk out loud' user test (6 participants) giving ...
user avatar
4 votes
3 answers
110 views

How many participants for a survey when you don't know the total population?

I have been using a sample size calculator to know how many participants I should have to have a sample and results that are representative for my total population. But what if we don't know the total ...
user avatar
5 votes
2 answers
128 views

How to analyse results for an open ended question?

I asked an open-ended question in a survey about one of our app's features (That is somewhat similar to its search feature) to find out why users would use this instead of search. I've got a large ...
user avatar
  • 10.5k
4 votes
1 answer
68 views

Can we use A/B testing for analyze new features?

Hello I'm quite newbie in UX, especially in A/B Testing methods. In my opinion and after I read some of articles. A/B testing usually used for analyze some new call to action button, copywriting, ...
user avatar
1 vote
1 answer
51 views

Quantifying the impact of offering alternative signup/login methods?

Nowadays it's common for websites to offer signup/signin methods that don't require making an account (email/password) for that specific site, for example 'Login with x': Facebook Google Twitter ...
user avatar
  • 291
0 votes
2 answers
70 views

Is there any value in a post user testing questionnaire considering the sample sizes being small?

I worked at company that after user testing sessions got users to complete a post testing questionnaire. The questionnaire tended to ask user for an NPS score, answer SUS (usability) questions and the ...
user avatar
-1 votes
3 answers
62 views

Is Triangulation both qualitative and quantitive?

Quick question: Is Triangulation both qualitative and quantitive?
user avatar
3 votes
3 answers
138 views

When do you choose quantitative research over qualitative research?

I want to know some of the discerning factors of a product that makes you choose quantitative over qualitative research and vise versa at any given time during a project.? Please elaborate when and ...
user avatar
  • 195
0 votes
1 answer
90 views

What process should be undertaken to get feedback from white-label clients?

I'm currently working with a company that distrbutes their white-label product and I was wondering what is the best process in order to get feedback from clients in regards to how their customers are ...
user avatar
0 votes
3 answers
136 views

Usability testing analysis

I've seen some researchers "behavioural analysis matrix" when analysing user testing sessions, they have participants at the top and tasks at the bottom and simply tick yes/no if participants complete ...
user avatar
4 votes
2 answers
75 views

Confidence intervals, Confidence levels and probability of simple tests

It seems to be a simple problem, but i cant figure it out Lets say, I would like to know if there is some point to implement new feature. If we have to focus on the feature or not. Lets assume there ...
user avatar
1 vote
1 answer
81 views

Why Conversion Rate + Abandonment Rate doesn't equal 100%?

I have created a funnel in google analytics with conversion rate 2.96% and abandonment rate 92.66% (Sum 95.62%). I would expect their sum to be 100%, do I miss something?
user avatar
  • 143
2 votes
2 answers
200 views

How to identify patterns from users survey comments

I have conducted an online survey where 1500 users participated. They have their opinions and comments about particular problems. I am trying to consolidate all their opinions & pulling out ...
user avatar
1 vote
1 answer
98 views

SUS evaluation on the same system but different sections and participants

Would it be okay to use 2 SUS scores to come up with a single score in the case I explain below: I conducted a user testing for a banking mobile app, the app under investigation has lots of tasks ...
user avatar
  • 93
0 votes
1 answer
2k views

What questions to ask in user interview to create better empathy map?

After an exhausted research in the topic of Empathy Map, I understand the critical parts of the most famous maps like 4 quadrants, and Xplaner(gamestorming book) v 1.0 and 2.0 types. They are met on ...
user avatar
3 votes
3 answers
505 views

How is design debt measured or calculated?

I think designers can probably relate to 'design debt' in the same way that developers relate to 'tech debt', and there are even examples of UX debt which is probably some combination of the cost ...
user avatar
  • 25.3k
0 votes
3 answers
169 views

How many users for a Beta product?

We are going to present the option to try the Beta version of our product to a sample population but we don't know how to calculate to how many of our users should we release it? Should I use the same ...
user avatar
0 votes
2 answers
197 views

User interface design comparison test

I need to elicit quantifiable responses to two designs. One is the live design, the other is a prototype, so I cannot evaluate directly via usability or ease of use. It has to be via Q and A. Anyone ...
user avatar
1 vote
1 answer
71 views

Simple way to determine the percent of various screen real estate commitments in competition?

In short, I want to analyse a number of web pages, let's say, specifically homepages of Vox and HBR (but also a dozen others). 1) I want to figure out how much screen real estate they're giving to ...
user avatar
  • 123
1 vote
2 answers
52 views

Quantifying Simplified Language

If you wanted to be able to quantify how much easier it is for users when you reduce the reading level of you text, how might you do that? For example, how would you figure out how much longer it ...
user avatar
0 votes
3 answers
104 views

Quantitative testing on other peoples websites

I want to test other peoples sites, but I want to collect quantitative data, as opposed to qualitative data. For example, I'd like to test the time it takes a user to navigate to a product page once ...
user avatar
  • 55
0 votes
1 answer
89 views

User Test with Task Scenarios That Have Unachievable Goals?

I intend to do quantitative user tests of an existing tool and compare its usability performance to a new design that I'd propose. Let's say after doing user research I come up with task scenarios (...
user avatar
1 vote
1 answer
31 views

how to get the conversion rate of a certain goal on google analytics? [closed]

I would like to know the current conversion rate and the expected conversion rate to use them on tools like VWO or optimize by google
user avatar
  • 159
1 vote
1 answer
72 views

Does using part of a usability questionnaire diminish its validity?

I'm interested in using QUIS (http://garyperlman.com/quest/quest.cgi) but the questions about system capabilities are irrelevant for my purposes as well as the questions about screens. I'm primarily ...
user avatar
  • 111
0 votes
1 answer
111 views

What's the best strategy for tracking events using Google Analytics?

We have a web-based enterprise analytics application, with many potential user interactions spread across many different reports. Thus we have potentially hundreds of trackable events. We are ...
user avatar
4 votes
1 answer
2k views

How many users do I need to run a SUS and get valid result?

I ran a System Usability Scale survey on my team (7 people) but I'm not sure that's enough to get relevant result and I didn't find any article recommending anything about the number of people to ...
user avatar
3 votes
1 answer
55 views

Best Way to Time Users Performing Physical Activities With Mobile Application?

I work in enterprise UX and need to measure metrics for how the usability of our future application will have improved work performance among users. The system the users use today does not record a ...
user avatar
4 votes
1 answer
305 views

User research and testing compared to ACSI (American Customer Satisfaction Index)

I came across through another UXSE question the idea of customer satisfaction index used in businesses as a means to improve products and services. It seems that the gold standard is the American ...
user avatar
  • 25.3k
2 votes
2 answers
344 views

Equivalent Scale in UX like the Cooper-Harper Scale?

Is there an equivalent scale in UX as the Cooper-Harper Scale or the Cooper-Harper Ratings are in Handling Qualities Engineering in Aerospace? The Cooper-Harper scale associates a quantitative value ...
user avatar
  • 121
3 votes
2 answers
333 views

Transforming coded qualitative data into a Likert scale

I'm analyzing a survey, and the requirements of the assignment are to transform the textual responses to a Likert scale. I've used grounded analysis to code the data, but now I'm not sure how to go ...
user avatar
7 votes
1 answer
1k views

Is there an updated Keystroke-level model for touch devices?

The Keystroke-level model was developed over the years to allow us to predict task times of a given set of interaction. Using this measurement is fantastic when brainstorming up potential UI solutions....
user avatar
4 votes
1 answer
420 views

Enterprise UX - Proving Improvement through Quantified Data?

I am working in an organization where I am focusing on improving the usability of enterprise applications (HR applications and other applications people are forced to use in order to complete their ...
user avatar
  • 211
1 vote
2 answers
150 views

What's a good approach to analyze a lot of answers to a survey with open questions?

We asked our users what's their main goal of current visit (open question). We received a lot of answers and I'm wondering what would be the best approach to analyze this data. In theory I could ...
user avatar
  • 111
0 votes
2 answers
642 views

Using SUS to measure usability of an existing system and compare with a redesigned system

I will be undertaking a whole-scale redesign of an existing system. I'd like to use SUS ("System usability scale") questionnaires to measure improvements between iterations. As a baseline, I want to ...
user avatar
2 votes
1 answer
71 views

Visualisation of 10-12 star-based-items in a review site

I need to create a page with 10 or 12 items. Each item is a criteria for review that can be voted by the user between 1 and 4 stars. But, the problem is that it is a really strange visualisation to ...
user avatar
0 votes
2 answers
7k views

Transforming qualitative and quantitative data or methods

I can see how a large number of interviews and video can be compiled and analysed numerically (i.e. turning qualitative research into quantitative research), but is it not possible to turn ...
user avatar
  • 25.3k
4 votes
2 answers
481 views

Should different users always be used for successive System Usability Scale testing?

A given project requires SUS scores for the current version of a piece of software, as well as the next version when it is prepared, to allow quantitative results to demonstrate any usability ...
user avatar
3 votes
4 answers
55k views

Definition and example to distinguish qualitative and quantitative research

I am looking for the best definition for qualitative and quantitative research. I wrote an article on UX Magazine in which I tried to address the need for doing research that tries to map what happens ...
user avatar
  • 25.3k
4 votes
4 answers
5k views

Quantitative and qualitative data used in UX research

I am trying to find examples of user behaviour research that combines both quantitative and qualitative data. It seems to me that most of the research leans heavily or exclusively towards one approach ...
user avatar
  • 25.3k
24 votes
8 answers
2k views

Quantifiable benefits of wireframing and prototyping?

I'm trying to come up with a few sources for quantifiable benefits of wireframing and prototyping, but I am having trouble finding results. I've seen plenty of "reduces requirements phase, ...
user avatar
  • 2,444
4 votes
2 answers
293 views

Quantitative Analysis of Cardsort Data

I'm working on some quantitative analysis procedures for cardsort (rank-ordering) type data. Are there established best practices for something like this? I was thinking cluster analysis, logit ...
user avatar
  • 145
1 vote
2 answers
168 views

How to utilize analytics for mobile consideration

The company I work for has about 15% of their users/prospective members coming from a Mobile non/desktop device. Though that is not a high number, it is still a decent number. The data is collected ...
user avatar
9 votes
4 answers
549 views

How to evaluate an interface without users?

I need to evaluate my application's novel interface. However, due to IRB issues I can not involve users for this stage of the evaluation. Previously, I asked How to quantitatively compare two ...
user avatar
1 vote
1 answer
756 views

Looking for best practice, articles, tests or studies on video placement on websites.

We are a publisher of many special interest (that doesn't mean x-rated! ;) news websites (tech, music, sport etc). The majority of our content is editorial but we obviously have a growing amount of ...
user avatar
8 votes
2 answers
1k views

How to quantitatively compare two interfaces?

I am in the process of building a tool to make some tasks easier than an existing application allows. Right now I am surveying users and receiving feedback but I want hard numbers. The only ...
user avatar
19 votes
7 answers
1k views

How to measure phone number views without annoying the user?

I'm working on a website where we have customer pages on which we measure user interactions such as opening a booking form or posting a review. One of the interactions we want to measure is when the ...
user avatar
17 votes
5 answers
2k views

How is a cluttered layout quantified?

In the comments of a different question, I asserted that Visual Studio has a "cluttered" layout. A different user disagreed with my assertion, and it made me curious as to how to quantify a cluttered ...
user avatar
  • 2,919
6 votes
3 answers
503 views

Quantitative methods for analysing vast Intranet IA

I have been asked to analyse and better group pages under a section of a large government website. The number of pages runs into the thousands. The problems I have is that metadata rules have not ...
user avatar
  • 8,180
9 votes
4 answers
370 views

What's recommended for the number of users to use in qualitative and quantitative testing?

I'm currently rebuilding our entire intranet from scratch, mostly because the tech behind is out-dated and it has been proved that a lot of information is difficult to find. Though that is beside the ...
user avatar
  • 248