1

I've been tasked with coming up with a way to quantify / asses the overall useability / user experience of our web application on a per-page basis.

What tools and methods do you use to achieve those standards and metrics?

4
  • System Usability Scale? Jan 9, 2013 at 19:24
  • As DA01 says below, there are many ways to assess usability. An appropriate methodology depends on the answers to a few questions, starting with: (1) how many pages in will be evaluated? The methodology will differ if there are few compared to many. (2) Do you need the appearance of objectivity offered by numbers, a written description of strengths and weaknesses, or an overall thumbs-up or thumbs-down per page? Jan 9, 2013 at 20:54
  • Ooops. I ran out of time editing the comment above. Here is more. (3) Whose assessment of usability do you need - usability experts, end users, or somebody else? Jan 9, 2013 at 21:00
  • @user1757436 there are quite a few pages in the app -- like 40-50. it needs to be assessed by our business contacts as well as our customers, and us.
    – Kristian
    Jan 9, 2013 at 23:23

2 Answers 2

3

Since a user rarely experiences just a page of your site by itself, I'd say a per-page evaluation is of questionable value. All that said, 'ux evaluation' can be done a number of ways. User testing, user surveys, heuristic evaluation, etc. For starters, I'd start with a heuristic evaluation.

3
  • +1 for heuristics. Nielsen's are the ones we've used in the past, they are usually a good start nngroup.com/articles/ten-usability-heuristics
    – gotohales
    Jan 9, 2013 at 16:53
  • for the sake of a fuller answer, can you please make a suggestion as to who's feedback should make up our heuristics data, and how many people's opinions would be appropriate for a reliable assessment?
    – Kristian
    Jan 10, 2013 at 19:57
  • 1
    There's no hard-and-fast rule about it, but you typically want people with some experience in what you are trying to measure. So in terms of usability and UX, you'd want people that have experience with usability and/or UX principals. One person can be enough, but sometimes it's nice to have 3 as it's good to bounce things off of each other, each person finds unique things, and having an odd number can break any stalemate debates.
    – DA01
    Jan 10, 2013 at 21:04
0

You don't do an 'overall' analysis - rather, you identify the key user behaviours, then measure how often they're happening / being followed to completion using user tests and analytics.

This allows you to value the state of an interface in directly business-oriented terms and define measurable, specific tasks to trial in user testing. More importantly, it also allows you to get support for actioning your findings - if you can't quantify how a bad UI is harming business goals, how can you expect the business to fund further development?

6
  • thank you for the reply. can you give some examples on how you go about collecting that information and the tools / methods you'd use to do it?
    – Kristian
    Jan 10, 2013 at 16:25
  • @Kristian - I'd speak with the project manager or business analyst, ideally when a product / page is first being planned. If you're the PM, then the question is - what user activities are most valuable to the organization? This will depend on your revenue model and how you monetize your service. In e-commerce, it's fairly obvious ("Users need to find the products they want and buy them"), in other domains it can be a little less clear ("We need to encourage social media sharing as part of our 2013 outreach strategy") Jan 10, 2013 at 17:08
  • you may be misunderstanding me. I do have all of that information already. my question is about how you gather and record your data. are you suggesting this is simply throwing in booleans and response times into a spreadsheet? or is there a more grand solution?
    – Kristian
    Jan 10, 2013 at 17:19
  • @Kristian - I don't really think you can 'score' matters that way. I don't really think this subject really lends itself to the kind of quantitative analysis you're hoping for. Jan 10, 2013 at 22:07
  • so, how do you keep score? how do you keep track of your results? is everything you do merely a discussion with no data to be kept from the exercise?
    – Kristian
    Jan 11, 2013 at 0:22

Not the answer you're looking for? Browse other questions tagged or ask your own question.