How do I conduct usability test on a new Win-8 Metro application when the expected users don't have any experience on that platform?
I'm going to test on PC and not on tablet.
Also for new users on Win8 platform I will ask to commit 1-2 tasks to get used to the Metro style apps such as - "Download a new application from store and update other applications if available..." - The participants should get to know the charms menu, and the app-bar functions before testing the actual app.
1) Check if your Metro UI app conforms to design guidelines ,here are some guidelines to get you started
2) Check for Accessibility
3) This link Seven Guidelines For Designing High-Performance Mobile User Experiences is generic with regards to app design and what are the attributes you need to look for but from an UX perspective they are applicable across all platforms