Take the 2-minute tour ×
User Experience Stack Exchange is a question and answer site for user experience researchers and experts. It's 100% free, no registration required.

Let's face it, in today's world - everything is moving fast and with approaches like agile, UX gets squeezed. It doesn't have to be this way and from what I hear many companies are using Sprint 0 approach to do some research before diving into develoment. However, I'm sure that doesn't solve every UX problem. With that said,

What ways to conduct user research quickly, cheaply and with results meaningful enough (and hopefully statistically significant) are there?

I'm curious if you do user research and how it works in your org (big or small).

Partly answering my question here but I know there are a lot of apps springing up geared towards testing/research, e.g. Loop 11, VerifyApp... Please include any of these in the answer where relevant.

share|improve this question
    
Hi firedrawndagger, please don't ask for personal experiences - it'll lead to the kind of discussion we don't allow here. Instead, ask for more objective answers such as "How can I conduct user research on a low budget and a tight deadline?" I edited your question a little to reflect these points. –  Rahul Feb 3 '12 at 7:50
    
@Rahul - thanks for clarifying, yeah I was just looking to what folks were doing around the edges of usability / side of their desks kind of thing. –  firedrawndagger Feb 4 '12 at 19:20
add comment

5 Answers

up vote 6 down vote accepted

You only need to test with five users. That's an oversimplistic point, and need is the key word, but the important point is that you can easily find most of the major issues with a small sample set. I think seeking statistical validity has you going down the wrong path.

You're not conducting peer reviewed research, you're conducting iterative tests on a single product. You don't need something you can run once and be 100% sure about, you should running tests every step of the way.

If you can't get five users each step of the way, test one user1:

As soon as you collect data from a single test user, your insights shoot up and you have already learned almost a third of all there is to know about the usability of the design. The difference between zero and even a little bit of data is astounding.

Steve Krug's Rocket Surgery Made Easy describes great ways to conduct quick, simple usability tests on the cheap, without professionals. Again, these won't catch every possible usability problem in one go, but they'll allow you to test repeatedly to catch new usability problems introduced or uncovered after design changes.

From the description, Krug's book can (and will) help you:

  • Test any design, from a sketch on a napkin to a fully-functioning web site or application
  • Keep your focus on finding the most important problems (because no one has the time or resources to fix them all)
  • Fix the problems that you find, using his "The least you can do" approach

Note for statistical validity you'll need a nice large sample, ideally of at least 30 so you can normalize results. Statistical validity is usually not a priority unless you're doing a simple survey as it requires a relative large number of participants for simple usability tests. Do not focus on this.

For specific tools, Usaura is a great quick and free resource to let you send quick tests to users over the internet. Note they don't let you test live interfaces but you can do some quick A/B testing on a visual layout of a page, ask some quick questions, or get a click map of where users think "where should you click to do...".

share|improve this answer
    
Neilsen's formula however makes this look rather more scientific than it actually is - the basic principle is true though - you don't have to test many users before you start to get repeats of issues. –  PhillipW Aug 19 '12 at 21:46
add comment

Assuming you have coworkers, hallway testing is about as inexpensive as it gets.

share|improve this answer
add comment

Sprint0 sounds very familiar :). Yes, Agile can be moving really fast. My frequent approach when there is no time to do usability test with the actual users of your system is to recruit in the company (no people working on the same project to avoid bias). Send an email and ask people to volunteer half an hour of their time. In my experience people find usability studies fun and usually getting enough people is not an issue.

Also you can try setting expectation for your dev team that design may still change; so if something is implemented you may feed additional changes into the design. How do you feed the changes into design? After usability tests you can create user stories that address identified usability issues and add them to the backlog or talk with a product owner so they can prioritize them.

I would be curious to know how others integrate UX into agile. I am a part of the agile team attending scurms, etc. In some other companies UX teams are more removed from the dev team.

share|improve this answer
    
I'm part of an agile scrum team and work as interaction designer. Right now, I introduce qualitative telephone interviews to our development process that will be flanked by online tools like online card sorting or click-through mock-ups. I identify active users of our system and contact them via e-mail asking if they're willing to take part. It works :) But I don't like to ask others in the company. Those people are not the real users (not the same as the target group, different concept models etc.pp.) –  Alexej Froehlich Aug 20 '12 at 12:40
add comment

Look at the book "The Lean Startup" by Eric Ries. Although the principles in this book are not specific to UX they could be applied to using UX in an agile organization. One of the basic principles is to experiment often in small increments using a split test. Make a small change to your app that you believe would provide a better UX and put half of your customers on the new design and half on the old design, collect metrics and compare. If the change has a positive outcome release it, if not throw it away. Move to the next test and iterate. Much easier to do on a web based application. The key is continuous incremental and iterative changes.

share|improve this answer
add comment

If you wanna do just a clik test or a five second test than http://usabilityhub.com/ is the right solution for you.

On the other hand for most usability test user, paper, laptop, and a webcam are more than enough... so they are not so expensive.

Here you can find an article on this topic

share|improve this answer
add comment

Your Answer

 
discard

By posting your answer, you agree to the privacy policy and terms of service.

Not the answer you're looking for? Browse other questions tagged or ask your own question.