2

We have a mobile app for different platforms. And now we want to improve the UX and UI. Due to the security policy, we cannot install analytic tools. I'm thinking of options we have to measure our design improvements impact: One-on-one A/B testing with 20 users per design to measure speed, number of errors, satisfaction rate etc. That's about 40 user tests per design update, which seems to be not realistically for our company. Any more variants or thoughts? Once in a few months we have 1 negative feedback about the design like "I don't like it" and some more feedback like "I like it".

Improve this question
2
  • By one-on-one I guess you’re referring to moderated usability tests? What about unmoderated ones? There are platforms out there that allow to automate the recruiting, testing and analytics. You can track task metrics, and have the tester’s voice to analyse the WHY behind a fail.
    – Andy
    Jan 24 at 16:28
  • Norman-Nielsen always talks about the fact that with ca. 7 participants, you'll see all important issues. So you might not need the full 20. Especially if you company is sceptical or short on budget (for this topic), starting with a small study might be a good way to demonstrate the usefulness of such feedback. If you fix all issues you find with 7 participants, your product will be much better compared to if you hadn't done any tests :-)
    – virtualnobi
    Sep 21 at 7:12

2 Answers 2

Reset to default
0

we use SUS questionnaire for our usability test in a company. It contains 10 questions which contains negative as well as positive feedback. The more information might be helpful here: https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html.

Improve this answer
2
  • How do you engage your users to fill in the questionnaire? The proposeds variant are not short, so the person probably should be very motivated.
    – Zhanna Krasynskaya
    Jan 8, 2020 at 15:05
  • We make in-house usability test so that many of the co-workers are inthusastics. The process takes place in five stages: 1. we ask them to tell about something themsleves. 2. Later on we introduce the product which we are going to test. 2. Theere are certain tasks which should be completed with users.
    – Manghud
    Jan 8, 2020 at 15:26
0

It's too bad you can't place Google Analytics, or similar traffic analysis tool, on your mobile app. Usage is always your best indicator of utility.

Many of the video testing platforms now include space for opinion polls or SUS scores. These can provide a quantitative context for what is a very qualitative way of assessing usability.

The video recordings, using "think-aloud" narration, are an excellent way to identify errors in mobile UI. If you haven't tried them out yet, demo UserTesting, Userlytics or UserZoom for video testing your mobile app.

Improve this answer
2
  • Actually you can use Google Analytics for your mobile app: developers.google.com/analytics/solutions/mobile
    – Kevin M.
    Jun 8, 2020 at 6:59
  • OT: I have Google Analytics turned off on all my browsers. What doesn't work without it, will be used only in very exceptional circumstances. I consider the dissemination of my usage data to Google to be a very bad (albeit hidden) user experience - some day, it'll come back in the form of advertising or manipulation.
    – virtualnobi
    Sep 21 at 7:10

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.