Has anyone ever conducted user testing on a mobile app or service with a large amount of people? (around 100 people). We plan to give the users the application and have them use it for 1 week. It would be great if anyone could give me some pointers for preparing and conducting the study.
I'd suggest that the main aspects you want to address with such a large group would be;
Hope this helps
I have already conducted an usability test with 45 people. We split the participants up into 5 peer groups of 9. Each peer group tested the same software, but in a different configuration (configurations varied in the gui design, in the interaction flow or in the automation level for certain tasks). Thus we were able to compare statistically, which configuration was the best to accomplish a certain task. For comparison, we calculated different metrics for each group:
The more people you have in each peer group, the more reliable the statistics will be.
If there are any design decisions in your app, for which alternatives exist, you can find out the best alternative with the help of a big user test. Find out metrics to measure the convenience of each alternative and put together peer groups to test the different alternatives.