Are there any benefits to using users who are not in your target market to test your website?
e.g a car website tested by users who don't drive
User Experience Stack Exchange is a question and answer site for user experience researchers and experts. It only takes a minute to sign up.Sign up to join this community
You are much more likely get more valuable user research if you research with users that are in your target demographic. Lets take a more extreme example: if I am developing a tablet app that is intended to be used by children with learning disabilities, it would probably not be the wisest move to test this on a motorcycle mechanic. But here our user persona is rather specific.
Okay so how about something else. If I am designing a website for people to buy or sell rare, antique and collectible motorcycles, that motorcycle mechanic now makes a lot more sense. He has a context of background knowledge about what he is going to want to look for when using this website.
Now the average person on the street probably knows very little about antique motorcycles, but they might now a bit about using ebay and other buy/sell type web platforms, so though they might not get me the best feedback, they still might stumble over the price filtering or the sign in/new account and I could learn a lot from seeing that.
So to sum it up, the more specialized your market is, or the more implicit (shared) background knowledge that is needed for that market, the more important it is for you to seek out users that will fit that criteria to test with. Despite all of that though, as long as your demographic isn't extremely specialized, there is still a huge opportunity for you to learn a lot by testing just about anyone. If you can provide enough context for them to know their motivation, you should definitely go for it! And don't forget, test early and often.
Ill leave you with this really fun article about Guerrilla Usability Testing.
Per your example of a car website and users who don't drive, you don't actually drive a website. Therefore, how would the usability of your website be any different if the user does or does not drive?
I think about the only thing that could be an issue by not having the target market test your website would be the actual content itself, as only the target market could effectively tell you whether or not it's up to par.
Functionality, accessability, usability, etc., can and should be tested by anyone. I would think you'd want a very diverse group for that anyway, to catch all the fringe exceptions.
Testing on your target group is of course very valuable. But testing out with your target group is also valuable:
If you test solely on your target group, you will limit (albeit to a good group) the range of scenarios you test against. Non typical users will not know what they're doing and you will get rich data by observing them try and solve a problem, compared to somebody who is experienced in the particular field.
To put it this way, if you were testing how quickly somebody could learn French, would you test on French speakers or non French speakers?