Tag Info

Hot answers tagged

20

Place demographic questions at the end of the survey. If you place them at the beginning, you will induce a phenomenon called stereotype threat. Stereotype threat says that if you remind someone of a stereotyped attribute of themselves, it will impact their performance even if they don't believe that stereotype. For example, suppose a girl has heard a ...


13

This article cites some studies about it: Some recent research in the Journal of Business and Psychology reveals that placing demographic items at the beginning of a survey increases the response rate to those items in comparison to demographic items placed at the end. And more importantly, it did not affect scores on the three noncognitive ...


10

A lot depends on the purpose of the voting, but the general rules that I would follow are: Show the votes before voting: the primary purpose of the voting is the sorting the posts / options you are allowed to vote on more than one post / option there are potentially many posts / options and you don’t need someone to have read them all before they vote ...


6

Show the result after the vote has been cast. This has to do with conformity (as you briefly mention yourself). Experiments (see f.ex. Asch's experiment) has shown that people in general, are affected by what other people do and say in groups, even if they initially was thinking or knowing differently. Therefor, showing a result before the vote is cast may ...


5

I don't see any disconnect at all between the two. Most people will have a faster response to objects on the right side of their visual field. So that applies to moving balls; tigers that want to eat you; etc. It is about a tiny increase in visual perception. This has nothing to do with learned importance. Reading from left to right has taught us that ...


4

It depends: where do you expect the application to be used? If most users will be in a relatively quiet, indoor environment, the conference room should be close enough, in my opinion--even if it's not exactly the same (at home vs. work, for example). However, if the expected environment of use is quite different, testing in a conference room won't be ...


4

If at all possible I'd try and observe actual behaviour, rather than ask a question. Because people suck at predicting their own behaviour. For example run a remote usability test with mocked up a google search result around your topic with a mix of .co.uk & .com (or whatever) company names/URLs and see which is clicked most. You also have to remember ...


3

Combine two research methods Start with usability testing, for the reasons that @Kit-Grose gave. Have a quick glance at the illustration in this NN/g post about UX-research methods to understand which methods can give you insights into user performance, and which methods can survey their opinions and ratings. Then follow that research with a method that ...


3

Aside from what is on that list, when I conduct usability tests I: Try to ensure that I give identical instructions to each participant. When people are doing tests remotely, it's easier to do this as you can provide written instructions. In person, however, I try extra hard to avoid going "off-script" and potentially leading anyone towards answers I ...


2

Go the middle way and give the users the freedom. What you want to avoid is users being subconsciously influenced by the currently leadning answer(s). Consequently, hiding the intermediary results of the poll from the user seems to prevent that. However, you must not force users to vote to access the results, if they are only interested in the results, and ...


2

You shouldn't really expect to get explicit feedback from a usability test (honest or otherwise); that's what focus groups and other such things are for. Usability testing is a way to test outcomes, not opinions. It's a great way to see if the changes have a noticeable improvement (or at least equivalence) when it comes to users performing a given set of ...


2

The problem with this kind of issue is that I suspect you would get different answers from different parts of the globe. I suspect (and this is just a suspicion - I have no evidence for this) that populations with US trade interests may favor the .com suffix as it is considered a larger 'global' entity rather than just confined to their country whereas ...


2

“All the world's a stage, and all the men and women merely players” I have conducted usability testing in a number of environments both controlled and uncontrolled and I genuinely believe that there is no silver bullet to deal with bias, but you do have to take precautions and consider impact on test results. Erving Goffman who was a very influential ...


1

If it's possible to ask context-based questions, ask this: Thanks for participating in our survey. Please pick which of the two sites you'd like to help us evaluate: [www.website.com] [www.website.co.uk] And adjust the second link to be whatever the local domain extension is. Ideally you'd randomize the position of both links too, because some ...


1

Have a look at 'Study: How Searchers Perceive Country Code Top-Level Domains' on Moz.com. Author Eli Schwartz presents some successful approaches to really get at 1. whether users are aware of general TLDs, 2. do users see a particular TLD (.edu specifically) as more trustworthy, 3. can users identify a particular location by the ccTLD used, and 4. can users ...


1

I came across an issue with meta programming in one early test I did. I was asking the following question: A form on a web page needs to have a way of clearing or submitting the data – traditionally this is handled with two buttons. One says ‘Cancel’ and the other says ‘Submit’. Of the two buttons, One is on the left and the other on the right. Which ...


1

I think you have to think about the type of survey and how it is conducted to start with. Generally people would regard demographic information as a barrier to completing the survey (they want it to be as short as possible for obvious reasons), so if you put it in front then it reduces a person's ability to be focused for the rest of the survey. On the other ...



Only top voted, non community-wiki answers of a minimum length are eligible