a method of analyzing an interface by the standard principles of usability. For questions regarding whether to conduct a usability study or how to best go about testing.

learn more… | top users | synonyms

8
votes
5answers
291 views

Simplest, cheapest solution for hosted A/B tests? [closed]

I'd like to test two designs for the same call-to-action before deploying the winner in anger. An ideal solution would host both designs on a single URL, record the results and generate usage ...
9
votes
4answers
487 views

Usability testing for open-source projects?

I'm working (slowly) on an open-source project, and I was hoping to do some usability testing once it's a bit further along. Also, hopefully the GIMP devs will notice this question ;-). I'm not sure ...
6
votes
2answers
227 views

Are there any easy to use A/B Testing frameworks?

How to do A/B testing is a difficult problem. Are there any frameworks or tools out there that ease the pain?
13
votes
5answers
497 views

What methods do you use to test the usability of an API?

Testing the usability of a programming interface poses a lot of challenges. It has a very different feel than testing a graphical interaction. The user can do almost anything at any time, as opposed ...
3
votes
5answers
430 views

Is A/B testing a worthwhile use of resources for the end user of a mobile app?

Web sites can enable A/B testing by serving a different page, for example. A mobile app would have to collect data and return it. As a matter of principle, is it okay to have software "phone home" ...
19
votes
7answers
349 views

What's the biggest surprise you've had in a usability test? [closed]

Usability tests often present some real surprises where the participant's mental model does not match what they're presented with. What are the biggest or most interesting surprises you've come ...
13
votes
5answers
251 views

How to rescue a usability test whose participant is lacking confidence?

Last night, I was conducting a usability test with a participant who was very uncertain of his actions. Before the test, I said all of the usual stuff about it being a test of the software and not ...
11
votes
5answers
925 views

How do you observe body language and facial expressions in user testing?

When user testing how do you record positive or negative body language? Do you use observed shifts in body language or facial expressions to consciously probe further about what the user thinks or ...
7
votes
3answers
181 views

What is the acceptable success score for user testing?

I'm just wondering how high of a success rate does the outcome of a user-testing have to be before you can consider it successful. I know that 100% is the target but if time and budget are limited, ...
9
votes
6answers
215 views

How do you find the balance between what the users' want and what the clients want?

You all know that project... After months of research, wireframing, prototyping, testing and workshops, there is that one client (normally the MD) that comes in at the end and knows everything better ...
13
votes
5answers
1k views

When does statistical significance matter?

When does the statistical significance of a usability test matter? I ask because in a recent Boagworld podcast, Steve Krug talks about how he recommends testing with only three users. When asked if ...
7
votes
9answers
509 views

Has anyone been to Jakob Nielsen or Steve Krug's day-long seminars? [closed]

Both these gentlemen are offering day-long seminars in London this spring: Jakob Nielsen - Fundamental Guidelines for Web Usability for £458 Steve Krug - Do-It-Yourself Usability Testing: The ...
13
votes
11answers
800 views

How do you take notes at speed?

One of the things that I've quickly found out when doing usability testing and field studies is that it's hard to keep up with the pace of what's going on and take sufficient notes. How do you cope ...
12
votes
5answers
338 views

Tips for A/B testing?

There seems to an increasing number of A/B testing services (such as Google Website Optimiser) and people using them. Have you got any tips on using and analysing the results from them?
11
votes
5answers
562 views

Production Reaction Cards - too many?

Microsoft Production Reaction Cards (doc) The set includes 118 words which presumably you would reorganise, format and print off as individual "cards". I've never used them but I do see how the tool ...
9
votes
4answers
185 views

A/B Testing. How should it be done?

I just stumbled upon Google Website Optimizer. Is this the way to go? How do you normaly do A/B tests with your website?
13
votes
9answers
175 views

How do you ensure that you've covered the whole site in your work?

I'm a relatively recent practitioner, and although my work's quality is pretty good, I still have one big back-draw (in my opinion): I always miss something or two when making or fixing a web site. ...
9
votes
4answers
931 views

Example video of a think-aloud protocol

I'm planning to use the think-aloud protocol for an upcoming usability test. A book chapter on think-aloud suggested that you show the participant an example video of someone thinking aloud. I think ...
13
votes
13answers
346 views

Ideal number of candidates for user-testing

I'm creating a draft proposal for some user testing involving several quite basic wireframe prototypes. How many participants would people recommend for this type of exercise? The intention would be ...
13
votes
6answers
299 views

How to test user in real situation?

What material and method could I use to record a usability test in real situation? I have to test some single user of an interface at their office desk, as they normally use it, without constraining ...
13
votes
12answers
442 views

When is automated remote usability testing useful?

There seem to be a fair few services these days offering automated remote usability testing, so I'm assuming there are a fair few people using those services, which implies that they ARE useful - ...
16
votes
14answers
387 views

Is user testing a luxury or a necessity?

I understand that you should be thinking of your users all the time but given the current climate where every pound counts is user testing just for the richer companies?? Should you discount your ...