I work at a small web development agency and I'm preparing to run a usability test on a web application we've built with a participant using a screenreader. Our development team just made a bunch of updates to the site to move it closer to ADA (Americans with Disabilities Act) compliance, so we're trying to find out if our first pass actually improved the site's accessibility and what work still needs to be done.
The problem is: I've never run a usability test with a participant using a screenreader. I have basic experience running usability tests, so I have an ok handle on how to moderate a test session, but I want to learn the basics of testing the user-friendliness of web accessibility features so I at least sort of know what I'm doing here :)
Specifically, I'm wondering:
Does anyone you have any advice on how to test the usability of a site's accessibility features?
What adaptations, if any, should I think to make to my typical usability test setup?
- The participant and I will be connecting remotely, I'm hoping over video call, with him sharing his screen. I have no idea if this'll work or if asking him to navigate through a video conferencing app (Google Hangouts) could complicate the test unnecessarily.
- Should I provide the participant instructions for using the site or can I leave them in the dark, let them figure out the site on their own?
- For a typical usability test, I'd want the participant to know as little as possible about the site under test, but I don't know if omitting usage instructions — included dev team's accessibility work — would prevent the user from even interacting with the site.
Sorry if my questions show my ignorance of web accessibility i.e. anything sounds goofy or dumb. I'm totally new to the topic. Thanks!