a method of analyzing an interface by the standard principles of usability. For questions regarding whether to conduct a usability study or how to best go about testing.

learn more… | top users | synonyms

7
votes
9answers
350 views

What are the pros and cons of getting design recommendations from usability test participants?

I'm looking over a usability report, and one thing is jumping out at me: at the end of each section in which an identified usability issue was discussed, is a section entitled "Recommendations." ...
5
votes
5answers
293 views

Proportion of resources devoted to UX Design & Research vs. Software Development on a web app?

First, some criteria: The product is an application and is heavy on user interaction. Think web 2.0 or mobile application, not a marketing or commerce site, or some back-end tool with only ...
5
votes
2answers
926 views

How to do a mobile field test?

The Smartphone have become a part of our daily life. Users are always online and use their Smartphone in very different environments. Smartphones are sometimes used in a calm, not distracting ...
2
votes
2answers
2k views

Advantages/disadvantages of mixed gender Focus Groups

I am planning to conduct a Focus group for car navigation devices in coming weeks. Initially, I was recruiting mixed gender participants in each session. I am slightly worried that; Males might ...
4
votes
2answers
185 views

How do you collect valuable information from regular “User Group” meetings?

The scenario: You work on a SaAS application. Some of your users use your application heavily each day. Every 2 weeks (or month or whatever), a "User Group" of your most avid users gets together to ...
9
votes
2answers
640 views

When Did Usability Testing Start?

I've been doing some research on the history of usability testing. What I've found out is that it has been done at least since 1981 at Xerox(based on unreliable source of Wikipedia). Can anyone ...
1
vote
3answers
517 views

What makes Silverback a usability program? [closed]

I can't get any reply from Clearleft, so I will ask here. What makes Silverback a usability program? I mean, it records audio and video, from webcam and desktop. Like many others. Does it show how ...
2
votes
6answers
252 views

User Testing and other best/most effective ways to implement UX in webpage

I am interested to know what some effective ways to determine and implement user experience would be. I think that user testing is a very effective one, i.e. getting people who are completely ...
3
votes
1answer
171 views

What would you need from a mobile usability testing service?

I'm thinking of launching a service similar to usertesting.com or trymyui for mobile website and apps. Developers submit their app or website along with testing scenarios. Scenarios would be ...
1
vote
2answers
256 views

What other solutions do you use besides A/B tests for testing the efficiency of two site structures?

I've designed new site structures for one of our clients, and want to test which brings better conversion rates. using A/B testing seems obvious but are there any other solutions to cite ...
5
votes
1answer
447 views

How to Assess UI complexity / Intuitiveness

Which tools / tests do you use to compare user interfaces in terms of complexity? So far, I applied the NASA-TLX.
7
votes
1answer
430 views

User Testing: 5-second test vs. 8-second test

I'm planning a "User Testing" and one of the tasks is the 5 (or 8) second test, so I want to know which fits better in my interface. I can't remember what article talks about the difference between ...
7
votes
6answers
1k views

Using Balsamiq Mockups with Usabilla for remote usability tests

We are defining the usability process for our company and are looking at tools for prototyping and remote usability testing. We would like to use Balsamiq Mockups to do our inital designs but have a ...
9
votes
4answers
529 views

Paying test subjects for user testing/beta testing

I've read that focus groups are a poor way of conducting user research as it attracts professional focus groupers who work the focus group "circuit" for a living. This obviously has major drawbacks as ...
3
votes
3answers
324 views

Are there turnkey services for simple usability testing of mobile apps, especially iOS?

For websites, usertesting and trymyui and others are setup to do quick user testing. Are there similar services for mobile applications?
11
votes
7answers
2k views

Who designs great UIs with usability testing?

If you want to make a usability expert twitchy and uncomfortable, ask her how companies like Apple can create acclaimed, wildly successful, and usable products using top-down design without ...
4
votes
4answers
339 views

How many users must be tested when doing usability, and why?

Please provide empirical data. Just to be clear, I will not accept Jakob Nielsen's Alertbox, March 19, 2000: Why You Only Need to Test with 5 Users without solid empirical data to back it up. I find ...
6
votes
5answers
512 views

How do you know when an interface is complete?

Meaning that a usability test measures if an interface meets the goals it sets, but only test what is present. How do I know when an interface is complete? Meaning a test, or measure of completeness, ...
4
votes
8answers
732 views

Any resources on user interface testing? [closed]

I'm not a user interface designer, but I test UI programs. Any pointers to things that user interface testers should know/consider when they test UI?
9
votes
4answers
274 views

What's recommended for the number of users to use in qualitative and quantitative testing?

I'm currently rebuilding our entire intranet from scratch, mostly because the tech behind is out-dated and it has been proved that a lot of information is difficult to find. Though that is beside the ...
8
votes
5answers
284 views

Simplest, cheapest solution for hosted A/B tests? [closed]

I'd like to test two designs for the same call-to-action before deploying the winner in anger. An ideal solution would host both designs on a single URL, record the results and generate usage ...
9
votes
4answers
468 views

Usability testing for open-source projects?

I'm working (slowly) on an open-source project, and I was hoping to do some usability testing once it's a bit further along. Also, hopefully the GIMP devs will notice this question ;-). I'm not sure ...
6
votes
2answers
221 views

Are there any easy to use A/B Testing frameworks?

How to do A/B testing is a difficult problem. Are there any frameworks or tools out there that ease the pain?
13
votes
5answers
349 views

What methods do you use to test the usability of an API?

Testing the usability of a programming interface poses a lot of challenges. It has a very different feel than testing a graphical interaction. The user can do almost anything at any time, as opposed ...
3
votes
5answers
425 views

Is A/B testing a worthwhile use of resources for the end user of a mobile app?

Web sites can enable A/B testing by serving a different page, for example. A mobile app would have to collect data and return it. As a matter of principle, is it okay to have software "phone home" ...
19
votes
7answers
325 views

What's the biggest surprise you've had in a usability test? [closed]

Usability tests often present some real surprises where the participant's mental model does not match what they're presented with. What are the biggest or most interesting surprises you've come ...
13
votes
5answers
221 views

How to rescue a usability test whose participant is lacking confidence?

Last night, I was conducting a usability test with a participant who was very uncertain of his actions. Before the test, I said all of the usual stuff about it being a test of the software and not ...
11
votes
5answers
827 views

How do you observe body language and facial expressions in user testing?

When user testing how do you record positive or negative body language? Do you use observed shifts in body language or facial expressions to consciously probe further about what the user thinks or ...
7
votes
3answers
157 views

What is the acceptable success score for user testing?

I'm just wondering how high of a success rate does the outcome of a user-testing have to be before you can consider it successful. I know that 100% is the target but if time and budget are limited, ...
9
votes
6answers
146 views

How do you find the balance between what the users' want and what the clients want?

You all know that project... After months of research, wireframing, prototyping, testing and workshops, there is that one client (normally the MD) that comes in at the end and knows everything better ...
12
votes
5answers
995 views

When does statistical significance matter?

When does the statistical significance of a usability test matter? I ask because in a recent Boagworld podcast, Steve Krug talks about how he recommends testing with only three users. When asked if ...
7
votes
9answers
466 views

Has anyone been to Jakob Nielsen or Steve Krug's day-long seminars? [closed]

Both these gentlemen are offering day-long seminars in London this spring: Jakob Nielsen - Fundamental Guidelines for Web Usability for £458 Steve Krug - Do-It-Yourself Usability Testing: The ...
12
votes
11answers
643 views

How do you take notes at speed?

One of the things that I've quickly found out when doing usability testing and field studies is that it's hard to keep up with the pace of what's going on and take sufficient notes. How do you cope ...
12
votes
5answers
320 views

Tips for A/B testing?

There seems to an increasing number of A/B testing services (such as Google Website Optimiser) and people using them. Have you got any tips on using and analysing the results from them?
11
votes
5answers
391 views

Production Reaction Cards - too many?

Microsoft Production Reaction Cards (doc) The set includes 118 words which presumably you would reorganise, format and print off as individual "cards". I've never used them but I do see how the tool ...
9
votes
4answers
173 views

A/B Testing. How should it be done?

I just stumbled upon Google Website Optimizer. Is this the way to go? How do you normaly do A/B tests with your website?
13
votes
9answers
169 views

How do you ensure that you've covered the whole site in your work?

I'm a relatively recent practitioner, and although my work's quality is pretty good, I still have one big back-draw (in my opinion): I always miss something or two when making or fixing a web site. ...
9
votes
4answers
817 views

Example video of a think-aloud protocol

I'm planning to use the think-aloud protocol for an upcoming usability test. A book chapter on think-aloud suggested that you show the participant an example video of someone thinking aloud. I think ...
13
votes
13answers
313 views

Ideal number of candidates for user-testing

I'm creating a draft proposal for some user testing involving several quite basic wireframe prototypes. How many participants would people recommend for this type of exercise? The intention would be ...
13
votes
6answers
286 views

How to test user in real situation?

What material and method could I use to record a usability test in real situation? I have to test some single user of an interface at their office desk, as they normally use it, without constraining ...
13
votes
12answers
379 views

When is automated remote usability testing useful?

There seem to be a fair few services these days offering automated remote usability testing, so I'm assuming there are a fair few people using those services, which implies that they ARE useful - ...
13
votes
13answers
346 views

Is user testing a luxury or a necessity?

I understand that you should be thinking of your users all the time but given the current climate where every pound counts is user testing just for the richer companies?? Should you discount your ...