Questions tagged [usability-testing]

a method of analyzing an interface by the standard principles of usability. For questions regarding whether to conduct a usability study or how to best go about testing.

Filter by
Sorted by
Tagged with
24
votes
5answers
43k views

Formative and Summative Usability Testing

I bumped into this document and it suggests the use of (a) Formative and (b) Summative Usability Testing. To be honest, is the first time that I bumped into this kind of terminology, and I while ...
10
votes
4answers
3k views

screen video capturing (usability test) on mobile

I'm trying to figure out how to conduct a usability test upon a handset device (smartphone). it seems there aren't many methods for screen video capturing of a user making use of an app. Do you know ...
50
votes
7answers
4k views

How do you prevent scope creep in agile projects when usability testing?

I have a client who recently asked me about this problem. I was wondering how you'd handle it? They are new to UX and to Agile methods, so they are struggling in interesting ways. As part of a ...
27
votes
3answers
2k views

Defining “Instantaneous” as part of usability acceptance criteria

The Setup I have run into this problem time and time again. An interface is performing slow and QA and/or Engineering come back and ask, "can you please define the acceptance criteria for how fast ...
18
votes
13answers
940 views

Ideal number of candidates for user-testing

I'm creating a draft proposal for some user testing involving several quite basic wireframe prototypes. How many participants would people recommend for this type of exercise? The intention would be ...
14
votes
5answers
2k views

What to do if SUS scores contradict qualitative feedback?

TL;DR: qualitative data collected in a usability experiment seems to contradict the quantitative results of the SUS questionnaire. How can this discrepancy be reconciled? The following experiment is ...
17
votes
1answer
560 views

Replacing all interaction in a complex UI with a single input field: Do successful implementations exist?

Main questions Can you provide examples of implementations that implement the suggested solution below? If yes, what are the benefits and drawbacks, especially as reported by users? As the SE ...
11
votes
6answers
623 views

How to find out usability problems myself?

I'm a tester. Currently when I see something that I don't like I suggest amending it and specify how. However I don't often see specific problems in application's usability and when I do I don't ...
5
votes
5answers
2k views

can you have duplicate Call to Actions (CTA) on a Page?

What is the number of duplicate CTAs that we can have on the page? For example, "Request for a demo". Can this CTA appear more than once? Thanks in advance. :)
3
votes
5answers
3k views

Why is embedded help not popular?

I'm wondering why modern help systems are more passive than active? For example, each good guide through something look like this: So why we don't see this directly on website (service provider), but ...
6
votes
2answers
2k views

Conducting a competitive analysis

What are the questions you need to ask or the methods you perform when you're doing a competitive web site analysis from a UX perspective? How do you gather the facts? When in the project process do ...
6
votes
4answers
2k views

How to A/B test a published IOS and Android app on actual users?

I've published several apps on IOS and Android adding flurry to measure the interaction that is happening in those apps, however, I'd love to enhance this interaction and make my apps more useful by ...
3
votes
2answers
2k views

How Long Does a Usability Study Take from Start to Finish?

This question will likely have no single correct answer, but I'm looking for personal estimates on how long it takes you to complete a usability study from start to finish, including research, writing ...
20
votes
4answers
15k views

How to test a website for visually impaired users?

What techniques should I be using when testing of a website for visually impaired users that commonly occur due to aging such as macular degeneration, needing reading glasses, possible loss of ...
17
votes
4answers
2k views

Recording Debit/Credit Card Details at the start of a 'Free Trial'?

Does anyone have experience, analytics or similar on the impact of taking payment details at the start of a free trial period for a product? It's one of the things I hate the most about trialing ...
16
votes
4answers
1k views

Should you reveal to the participants where they 'went wrong' during usability tests?

I realise 'went wrong' is not the correct term here. We're not testing the user, we're testing the site. (Hence the quote marks). Anyway: Take this hypothetical scenario: You're running a usability ...
15
votes
5answers
3k views

When does statistical significance matter?

When does the statistical significance of a usability test matter? I ask because in a recent Boagworld podcast, Steve Krug talks about how he recommends testing with only three users. When asked if ...
14
votes
5answers
693 views

What ways to conduct user research quickly and cheaply are there?

Let's face it, in today's world - everything is moving fast and with approaches like agile, UX gets squeezed. It doesn't have to be this way and from what I hear many companies are using Sprint 0 ...
6
votes
7answers
3k views

Finding out how users respond to look and feel

If you wanted to put designs in front of users and test how they feel about the visual designs look and feel. What questions could you ask to explore how users feel without being leading?
5
votes
4answers
2k views

Where is the best way to approach hallway usability testing?

I found UserTesting.com but it costs $40 per person which is super expensive. I want to test if I am communicating the correct message to users on our site. Where is a good place to do some hallway ...
17
votes
2answers
2k views

5-second tests vs. the short-term memory

I've recently been participating in random tests on http://usabilityhub.com and I find myself cringing when the 5-second tests come up and feeling guilty at my seemingly useless responses once I'm ...
15
votes
5answers
381 views

How to rescue a usability test whose participant is lacking confidence?

Last night, I was conducting a usability test with a participant who was very uncertain of his actions. Before the test, I said all of the usual stuff about it being a test of the software and not him,...
12
votes
5answers
469 views

Tips for A/B testing?

There seems to an increasing number of A/B testing services (such as Google Website Optimiser) and people using them. Have you got any tips on using and analysing the results from them?
9
votes
4answers
365 views

What's recommended for the number of users to use in qualitative and quantitative testing?

I'm currently rebuilding our entire intranet from scratch, mostly because the tech behind is out-dated and it has been proved that a lot of information is difficult to find. Though that is beside the ...
9
votes
3answers
391 views

When to end usability test task

I was wondering: if participant thinks he has found the solution to a task, do you end the task even if the solution is the wrong one? Eg. you task the participant to find some information, but he ...
9
votes
2answers
526 views

Does anyone have statistics on usage of the Kano Model?

I have been asked by a client to provide justification for the usage of the Kano Model. I believe I have sufficiently convinced them of the benefits and value, but the one thing I am lacking is ...
8
votes
2answers
196 views

How can I get hold of customers and users for research and usability testing when the business is protective or needs approval each time?

One of the things I find most difficult is while we (designers and devs) are working in an iterative agile environment, getting a hold on users and customers and trying to meet them in regular basis ...
6
votes
5answers
576 views

How do you know when an interface is complete?

Meaning that a usability test measures if an interface meets the goals it sets, but only test what is present. How do I know when an interface is complete? Meaning a test, or measure of completeness, ...
4
votes
4answers
485 views

How many users must be tested when doing usability, and why?

Please provide empirical data. Just to be clear, I will not accept Jakob Nielsen's Alertbox, March 19, 2000: Why You Only Need to Test with 5 Users without solid empirical data to back it up. I find ...
4
votes
2answers
1k views

Measuring/Quantifying Usability & User Experience

This morning i was looking online for articles that could lead me to a method that can be used to measure/quantify usability & user experience. The method i was interested in finding more ...
12
votes
3answers
2k views

How do users react to a browser request for geolocation?

Is there a study about a user's reaction to a browser request of a geolocation? What is the percentage of acceptation? In which case? What triggers acceptance and what triggers denial?
12
votes
5answers
4k views

How does e-commerce product quick view affect conversion rates?

Many large e-commerce retailers are using "quick views" for products on their collection pages where more details appear either on-hover of via some other trigger. Has anyone performed any A/B tests ...
8
votes
2answers
673 views

Do users behave differently to interactive lo-fi wireframes compared to hi-fi mockups in user testing sessions

We're designing a product feature for a mobile app and would like to test it using invision(so it is interactive) on some users before we start working on any hi fidelity design. In theory this is ...
4
votes
3answers
855 views

How to design the optimal UI/UX test teaching lab?

Imagine you are training the next generation of UI designers and UX experts at a university, and the department just gave you a big pile of money to spend. How does the ideal testing lab look? (I ...
3
votes
3answers
293 views

Whom should we design for? Early Adopters or Late Adopters?

If we categorize the users as "Early Adopters" and "Late Adopters", whom should we design for? The categorization is not just based on their age, but their capabilities or interest towards adopting ...
18
votes
14answers
480 views

Is user testing a luxury or a necessity?

I understand that you should be thinking of your users all the time but given the current climate where every pound counts, is user testing just for the richer companies? Should you discount your ...
11
votes
4answers
3k views

Form Design: Mutually Exclusive Tabs vs. One Form

I am working on a form design that has two mutually exclusive forms accessible via tabs (Option 1). During usability testing my team observed users missing the tabs and only noticing them when we ...
7
votes
9answers
845 views

What are the pros and cons of getting design recommendations from usability test participants?

I'm looking over a usability report, and one thing is jumping out at me: at the end of each section in which an identified usability issue was discussed, is a section entitled "Recommendations." ...
4
votes
2answers
265 views

How do you collect valuable information from regular “User Group” meetings?

The scenario: You work on a SaAS application. Some of your users use your application heavily each day. Every 2 weeks (or month or whatever), a "User Group" of your most avid users gets together to ...
4
votes
2answers
2k views

Where can I find existing System Usability Scale (SUS) results to compare against?

I'm looking for a resource of existing System Usability Scale (SUS) study results to compare against. I've read in a few papers/webpages that plenty of such data is available, unfortunately I can't ...
4
votes
2answers
474 views

Should different users always be used for successive System Usability Scale testing?

A given project requires SUS scores for the current version of a piece of software, as well as the next version when it is prepared, to allow quantitative results to demonstrate any usability ...
3
votes
2answers
2k views

Framework or plugin for tracking user actions on a web application

I've been working for a while on various proof-of-concept applications for social network privacy, which I've evaluated for publication with various user studies. Is there a useful, free, framework (...
3
votes
7answers
7k views

Should external link open in same tab or new tab? [duplicate]

What is best case scenario for external link to open in new tab or same tab? and Why? When do we use external link? Is it when the data is linking to some external page other than your existing page.
3
votes
2answers
92 views

How can I test a users decision to buy something?

I am working for a quite large online store. We want to start user tests inhouse. As far as I know you can test functionalities with user tests. But our brand is a way of life and many of our ...
1
vote
2answers
203 views

Best order of user research

Context I'm planning on doing user testing and research to help improve the UI and UX of our portal/website.There are a lot tools to help improve your product. Think of tools like card sorting, user ...
6
votes
2answers
831 views

Has anyone got experience of Feng GUI and been able to test it against real users?

One of my team is looking at using Feng GUI http://www.feng-gui.com/. Does anyone have experience of it and/or been able to test it against results of eye-tracking of real users?
4
votes
3answers
4k views

What do Sample Size and Effect Size mean in terms of A/B testing?

What does "Sample size" and "effect size" means in terms of A/B testing? Can anyone explain in simple words with an example?
3
votes
3answers
1k views

Does gender affect the results of a usability test?

There's a question on Quora asking for opinions about subjects' gender impact on usability tests. I think this topic is very interesting given that people of different genders prefer different visual ...
3
votes
2answers
286 views

Choice of Programming Languages and UX

A bit of context Before anything, this is NOT a question about programming, but of course it's related. My context is as follows: I own a small consultation firm with a development area. We deal ...
2
votes
2answers
223 views

How to design a 'Search for Duplicates' GUI in an Image Cataloging Program

We have an image cataloging program in which we have a database holding the already cataloged images. Let's call them "The Archive". Of course, everyone wants to keep the Archive clean, hence we ...