I'm new to UX research, and I am on a small UX project just for the sake of practice.

Before conducting a usability test, I understand that I need to know the user's pain points in certain products or services, but I don't have an access to this data. I decided to conduct a survey about a Facebook page, to profile the users and also to ask them to identify problems that I can use to construct the usability-test tasks, or scenarios.

My goal for this survey is to identify the major usability problems that users face while using the Facebook page. I just created a survey, and I'm not sure if I did it right.

Could any UX professionals comment on the survey I created?

Thank you so much! any comments would be helpful!

  • Hi @Kenny, Welcome to ux.stackexchange.com. I've done a few things to help you, on this page. If you review the Help > Tour (see the link, above left), you'll see this site discourages open-ended questions, but I think that's what you've posted. You might get a better response if you focus on specific parts of your survey. In the meantime, I also provided an answer, somewhere below, that suggests your survey might—or might not—be heading you in the right direction. I recommend a bit of reading. I provided some links in my response, below. Hope that helps. – JeromeR Aug 31 '15 at 6:40

You've got the general idea

It's a great idea to ask users what they dislike and then to set about proving them right or wrong by conducting a usability test before you spend resources fixing the perceived problem. Users often complain about a symptom without recognizing the underlying design problem.

If this is what you intend to do, then your survey is a good step forward. (I'm leaving it to others to comment on your survey design.) If this is not what you intended to do, then please read on.

Typical usability testing

Typically, you would have a specific feature in mind that needs testing. If you don't have a specific feature in mind, then you might want to determine their goals—so what users do on the site. You could infer this by looking at site traffic, log data ("analytics"), by asking them, and so on. You might also ask your Product Management team or your Marketing team what their goals are for the site.

Note that "asking them" could involve a survey.

Then you would develop scenarios that require users to complete specific tasks related to those goals. After screening and scheduling your participants, you would observe and measure their performance. Or, if you use automated testing, you would allow the system to gather data that you review.

Your analysis of user performance will reveal the usability problems. This would result in recommendations that you prioritize. This typically considers cost to fix the problem, seriousness of the problem, and the company's marketing focus and Product Management goals.

A bit of reading

Here are some articles you might find interesting.

I hope that helps you move forward.

  • 3
    Also.... Don't ask them what they like or dislike about the product, have them show you. The moment you ask for an opinion, they are going to think too much about it and potentially go away from what they usually do. – Majo0od Aug 31 '15 at 11:50
  • 1
    Thank you Jerome! and I will be more careful about how to phrase the questions next time! Thank you for your input! – Kenny Aug 31 '15 at 18:02

I'd skip the survey and just do the usability tests.

UX pros tend to distrust surveys since you're asking people to recall their behaviors. And people tend to answer questions in not quite honest ways.

For example, in your survey, I can try to remember what my top three features are, but I'm not sure what a feature is, and I might not want to admit that I spend a lot of time stalking my ex. And I could come up with some features I'd like to see, but never actually use them when they're developed.

Instead, just do usability tests - preferably in person - and observe users perform the most common tasks for the app.

If you have to use a survey... (1) Ask questions like this: "How many times in the past month have you used [Feature A]?" The answer choices can be ranges: Never, Daily, Weekly, Once a month.

(2) List the features people can choose from.

(3) I wouldn't use "Rate your satisfaction" questions. You and I might be equally satisfied with a thing, but I'll give it a 4 and you'll give it a 5.

  • Thank you Ken! I also thought about jumping right into the usability test, and one thing came up after how-to-do research on usability test is that it's hard to come up with the tasks I want to ask users. Do you think I just come up with the tasks I think people use the most and use them for usability test? – Kenny Aug 31 '15 at 18:12
  • Sometimes it's pretty obvious what the primary tasks are: find and buy a thing, add a friend, make a post, etc. And sometimes you're testing a particular task that you want to verify the design of. – Ken Mohnkern Sep 1 '15 at 14:24

If you don't know how to make a survey, don't reinvent the wheel. Use an existing survey. That way, your results gain authority ("I used a valid method"), you can compare your result to published results of others who used the same survey, and you save yourself work in general.

For a quick and dirty solution, the most common survey would be the SUS. The QUIS is also popular, but a bit oldschool in the freely available version. There are also PSSUQ, SAMI and a few others. I'm personally also fond of the Bargas-Avila questionnaire1. It doesn't have a specific name, but it's nice, short, to the point, and was validated on a very large number of participants.

I also recommend reading a good book on the subject. "Measuring the user experience" is a favorite of mine, based on solid academic theory but written specifically for the practitioner. It is a very hands-on book and leads you around the multitude of traps you didn't see lurking on your way, for example: "What do I do with the mountain of data I just gathered so I transform it into knowledge?" There are also several others, you can research them and pick the one you like. Reading one of those has a really high return on investment of your time.

1 Bargas-Avila, Javier A., et al. "Intranet satisfaction questionnaire: Development and validationof a questionnaire to measure user satisfaction with the Intranet." Computers in Human Behavior 25.6 (2009): 1241-1250.

  • Thank you Rumi for your input! I'll try to search an existing survey I can use for. Just the quick questions is that I thought SUS and QUIS, and others you mentioned above are the post-usability session ratings. Can you also use them to find user's problems so I can use them to construct the usability test? – Kenny Aug 31 '15 at 18:07
  • @Kenny maybe I misunderstood your situation. I thought you already have a version of the system you want to test, maybe a prototype, and you want to find out what the problems are with this system. In this case, you can use SUS and co to find out what is missing from the system. If the users haven't interacted with the system yet, then you can't use the questionnaires that way. – Rumi P. Sep 1 '15 at 8:32

If you're interested in UX in a more holistic way (and not just in usability), you might consider using the AttrakDiff scale (http://attrakdiff.de/index-en.html) or the User Experience Questionnaire (http://www.ueq-online.org/). Although both questionnaires were developed in academia, they are fully applicable in practice.

Your Answer

 
discard

By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

Not the answer you're looking for? Browse other questions tagged or ask your own question.