I work for a company that provides complex software for users to create augmented reality experiences. Think Unity in a browser for AR. We would like to perform usability studies and I'm a bit stuck about exactly what to test and how to test it.
Our tool is pretty complex and is also very freeform i.e. there isn't really an order of operations they need to complete once they have created their project and the end result varies widely between customers. This is similar to something like Figma where the tool can be used for a wide variety of tasks and also requires some knowledge of the product to be able to effectively use it.
I thought about testing individual features, but am concerned that won't be useful without using them in the context of the full project e.g. testing the animation tool without knowing how that animation will work in the context of the full end experience
- How do you define a usability study and/or task list for something so complex?
- How do you test this on users who have been using the software for a while and are now used to the product?