a method of analyzing an interface by the standard principles of usability. For questions regarding whether to conduct a usability study or how to best go about testing.

learn more… | top users | synonyms

4
votes
2answers
131 views

Is there any research on mitigating the effects of using a non-representative user group on measuring perceived usability?

My client is running a series of vendor demonstration where they want the staff to measure the perceived usability of the system (SUS and SEQ). Originally we asked for a consistent group of ...
8
votes
6answers
506 views

How to design user evaluation tasks without leading people to 'the answer'?

By way of example: on the site I am testing I have a page that shows a piece of information; and a side panel that shows related / similar information from other areas of the site. How do I test ...
4
votes
2answers
338 views

Beta testing: How should users be selected?

We'd like to get data and feedback from real users on a new search principle on a live page (not A/B testing because too many things were changed). Question: How should participating users be ...
10
votes
5answers
304 views

What do you wish you had known before your first ever user evaluation workshop?

What have you learned from the process of testing prototypes / products with users that you wish you had known before you went into your first workshop? Pitfalls, freak-out moments etc?
10
votes
6answers
4k views

Open source / free screen capture tools for user testing [closed]

What free tools are there on the Windows platform that I can use to capture what mouse movements and clicks a user makes during an evaluation? Ideal product would: Not be likely to crash and freak ...
-1
votes
1answer
150 views

Android application for London Transport (usability ?) [closed]

I'm developing the Android application for London Transport which includes Journey Planner, Tube status, Live Departures Boards, Maps, Finding a taxi function and so on. I'd like to get some ...
7
votes
6answers
400 views

Plus icon for new tab not working in user testing. Anomaly or actually confusing for users…

For Context: So I am performing some user testing, and the interface is changing how tabs work with in the system. Currently tabs indicate the top level of different customer define hierarchies. The ...
6
votes
10answers
573 views

Isn't all user testing essentially a way of gathering how people think things should work?

When user testing is performed, users are often presented with a serious of variations of a product and observed to see where they excelled and where they had trouble. People will often click in areas ...
4
votes
2answers
185 views

What are some best practices when doing testing to compare different design ideas?

There's a particular feature of our (B2B) app that seems to be causing a lot of confusion. (It involves lists of urls, some of which can be quite long, and giving different statuses to different ones. ...
6
votes
3answers
3k views

Usability testing software with Eye tracking tools [closed]

I took a course in Human Computer Interaction last semester, and I find it very interesting. I am working on a website project, and thought I would try some user involvement. I was thinking about ...
1
vote
1answer
129 views

Is there any testing methodology similar to A/B testing, but without a specific goal?

Please forgive me; this may be somewhat long-winded. I work in an academic library. I'd like to study how well assorted features of our site are serving our users' needs; for example, labeling of UI ...
2
votes
5answers
920 views

Explaining small sample size---influencing stakeholders

I am new to the user experience world. Based on some references I've read and threads here, it's Ok to determine statistical significance and compare means for a small sample size of 11 (7 users in ...
4
votes
4answers
476 views

Has anyone usability tested (handwritten) email before?

I was just reading this article: How to send and reply to email. It's basically about the user interface and user experience of email. There are many good tips, but unfortunately the article doesn't ...
7
votes
9answers
378 views

What are the pros and cons of getting design recommendations from usability test participants?

I'm looking over a usability report, and one thing is jumping out at me: at the end of each section in which an identified usability issue was discussed, is a section entitled "Recommendations." ...
5
votes
5answers
328 views

Proportion of resources devoted to UX Design & Research vs. Software Development on a web app?

First, some criteria: The product is an application and is heavy on user interaction. Think web 2.0 or mobile application, not a marketing or commerce site, or some back-end tool with only ...
5
votes
2answers
931 views

How to do a mobile field test?

The Smartphone have become a part of our daily life. Users are always online and use their Smartphone in very different environments. Smartphones are sometimes used in a calm, not distracting ...
2
votes
2answers
2k views

Advantages/disadvantages of mixed gender Focus Groups

I am planning to conduct a Focus group for car navigation devices in coming weeks. Initially, I was recruiting mixed gender participants in each session. I am slightly worried that; Males might ...
4
votes
2answers
196 views

How do you collect valuable information from regular “User Group” meetings?

The scenario: You work on a SaAS application. Some of your users use your application heavily each day. Every 2 weeks (or month or whatever), a "User Group" of your most avid users gets together to ...
9
votes
2answers
659 views

When Did Usability Testing Start?

I've been doing some research on the history of usability testing. What I've found out is that it has been done at least since 1981 at Xerox(based on unreliable source of Wikipedia). Can anyone ...
1
vote
3answers
527 views

What makes Silverback a usability program? [closed]

I can't get any reply from Clearleft, so I will ask here. What makes Silverback a usability program? I mean, it records audio and video, from webcam and desktop. Like many others. Does it show how ...
2
votes
6answers
255 views

User Testing and other best/most effective ways to implement UX in webpage

I am interested to know what some effective ways to determine and implement user experience would be. I think that user testing is a very effective one, i.e. getting people who are completely ...
3
votes
1answer
173 views

What would you need from a mobile usability testing service?

I'm thinking of launching a service similar to usertesting.com or trymyui for mobile website and apps. Developers submit their app or website along with testing scenarios. Scenarios would be ...
1
vote
2answers
259 views

What other solutions do you use besides A/B tests for testing the efficiency of two site structures?

I've designed new site structures for one of our clients, and want to test which brings better conversion rates. using A/B testing seems obvious but are there any other solutions to cite ...
5
votes
1answer
505 views

How to Assess UI complexity / Intuitiveness

Which tools / tests do you use to compare user interfaces in terms of complexity? So far, I applied the NASA-TLX.
7
votes
1answer
444 views

User Testing: 5-second test vs. 8-second test

I'm planning a "User Testing" and one of the tasks is the 5 (or 8) second test, so I want to know which fits better in my interface. I can't remember what article talks about the difference between ...
7
votes
6answers
1k views

Using Balsamiq Mockups with Usabilla for remote usability tests

We are defining the usability process for our company and are looking at tools for prototyping and remote usability testing. We would like to use Balsamiq Mockups to do our inital designs but have a ...
9
votes
4answers
543 views

Paying test subjects for user testing/beta testing

I've read that focus groups are a poor way of conducting user research as it attracts professional focus groupers who work the focus group "circuit" for a living. This obviously has major drawbacks as ...
3
votes
3answers
328 views

Are there turnkey services for simple usability testing of mobile apps, especially iOS?

For websites, usertesting and trymyui and others are setup to do quick user testing. Are there similar services for mobile applications?
11
votes
7answers
2k views

Who designs great UIs with usability testing?

If you want to make a usability expert twitchy and uncomfortable, ask her how companies like Apple can create acclaimed, wildly successful, and usable products using top-down design without ...
4
votes
4answers
348 views

How many users must be tested when doing usability, and why?

Please provide empirical data. Just to be clear, I will not accept Jakob Nielsen's Alertbox, March 19, 2000: Why You Only Need to Test with 5 Users without solid empirical data to back it up. I find ...
6
votes
5answers
517 views

How do you know when an interface is complete?

Meaning that a usability test measures if an interface meets the goals it sets, but only test what is present. How do I know when an interface is complete? Meaning a test, or measure of completeness, ...
4
votes
8answers
754 views

Any resources on user interface testing? [closed]

I'm not a user interface designer, but I test UI programs. Any pointers to things that user interface testers should know/consider when they test UI?
9
votes
4answers
283 views

What's recommended for the number of users to use in qualitative and quantitative testing?

I'm currently rebuilding our entire intranet from scratch, mostly because the tech behind is out-dated and it has been proved that a lot of information is difficult to find. Though that is beside the ...
8
votes
5answers
288 views

Simplest, cheapest solution for hosted A/B tests? [closed]

I'd like to test two designs for the same call-to-action before deploying the winner in anger. An ideal solution would host both designs on a single URL, record the results and generate usage ...
9
votes
4answers
476 views

Usability testing for open-source projects?

I'm working (slowly) on an open-source project, and I was hoping to do some usability testing once it's a bit further along. Also, hopefully the GIMP devs will notice this question ;-). I'm not sure ...
6
votes
2answers
223 views

Are there any easy to use A/B Testing frameworks?

How to do A/B testing is a difficult problem. Are there any frameworks or tools out there that ease the pain?
13
votes
5answers
386 views

What methods do you use to test the usability of an API?

Testing the usability of a programming interface poses a lot of challenges. It has a very different feel than testing a graphical interaction. The user can do almost anything at any time, as opposed ...
3
votes
5answers
426 views

Is A/B testing a worthwhile use of resources for the end user of a mobile app?

Web sites can enable A/B testing by serving a different page, for example. A mobile app would have to collect data and return it. As a matter of principle, is it okay to have software "phone home" ...
19
votes
7answers
339 views

What's the biggest surprise you've had in a usability test? [closed]

Usability tests often present some real surprises where the participant's mental model does not match what they're presented with. What are the biggest or most interesting surprises you've come ...
13
votes
5answers
235 views

How to rescue a usability test whose participant is lacking confidence?

Last night, I was conducting a usability test with a participant who was very uncertain of his actions. Before the test, I said all of the usual stuff about it being a test of the software and not ...
11
votes
5answers
878 views

How do you observe body language and facial expressions in user testing?

When user testing how do you record positive or negative body language? Do you use observed shifts in body language or facial expressions to consciously probe further about what the user thinks or ...
7
votes
3answers
166 views

What is the acceptable success score for user testing?

I'm just wondering how high of a success rate does the outcome of a user-testing have to be before you can consider it successful. I know that 100% is the target but if time and budget are limited, ...
9
votes
6answers
185 views

How do you find the balance between what the users' want and what the clients want?

You all know that project... After months of research, wireframing, prototyping, testing and workshops, there is that one client (normally the MD) that comes in at the end and knows everything better ...
13
votes
5answers
1k views

When does statistical significance matter?

When does the statistical significance of a usability test matter? I ask because in a recent Boagworld podcast, Steve Krug talks about how he recommends testing with only three users. When asked if ...
7
votes
9answers
488 views

Has anyone been to Jakob Nielsen or Steve Krug's day-long seminars? [closed]

Both these gentlemen are offering day-long seminars in London this spring: Jakob Nielsen - Fundamental Guidelines for Web Usability for £458 Steve Krug - Do-It-Yourself Usability Testing: The ...
12
votes
11answers
710 views

How do you take notes at speed?

One of the things that I've quickly found out when doing usability testing and field studies is that it's hard to keep up with the pace of what's going on and take sufficient notes. How do you cope ...
12
votes
5answers
328 views

Tips for A/B testing?

There seems to an increasing number of A/B testing services (such as Google Website Optimiser) and people using them. Have you got any tips on using and analysing the results from them?
11
votes
5answers
470 views

Production Reaction Cards - too many?

Microsoft Production Reaction Cards (doc) The set includes 118 words which presumably you would reorganise, format and print off as individual "cards". I've never used them but I do see how the tool ...
9
votes
4answers
179 views

A/B Testing. How should it be done?

I just stumbled upon Google Website Optimizer. Is this the way to go? How do you normaly do A/B tests with your website?
13
votes
9answers
171 views

How do you ensure that you've covered the whole site in your work?

I'm a relatively recent practitioner, and although my work's quality is pretty good, I still have one big back-draw (in my opinion): I always miss something or two when making or fixing a web site. ...