0

I believe the wording in one of the scenarios of my user test might be mis-leading the participant to click somewhere else on my prototype. I have already tested two participants and this is what raised my concern but I have six more participants to test. Before I continue testing, is it ok to change the wording in the scenario for the remaining six participants? Does changing the scenario effect the validity of the results?

3
  • Is the bias in the existing wording or are you introducing a bias? You could give an example of what are you trying to change.
    – Chris
    Mar 28 at 12:42
  • It really depends on how major the change is. It could go either way. Could you please post what you changed? Thanks.
    – Izquierdo
    Mar 28 at 17:05
  • In the scenario, I used the words, update your account and in the navigation there is a link called your account, which doesn't have anything to with the task. But I am noticing participants clicking on this first. I wonder if I am misleading the participant.
    – Sam
    Mar 28 at 21:55

1 Answer 1

0

A good rule of thumb when creating scripts for user testing for your scenarios is to build in a little bit of flexibility for situations like this. But as the comments suggest it really depends on that particular question as well as the rest of the tasks in your user test.

Generally I try to focus on the information that I need to obtain from the users rather than following a strict script and just see what information they will offer. The reason for this is that unless you are doing a very large study with a very high number of participants, it is difficult to rule out any particular effects that might be affecting the user response and make adjustments in your analysis. For smaller number of participants like an interview, it is hard to tell whether it is just something that a particular participant that is causing the difference in what you are observing.

A really good way to try and rule this out is to just do a dry run of the user test with internal team members don't have any prior knowledge of what you are testing, and that way you might get some idea whether the wording is causing general interpretation issues for specific users or not.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.