reaching out to see if any other UXers have experience collecting automated data for software KPIs (did a quick search for related question, and didn't find anything. Apologies if this has been asked before).
Obviously, user testing is the best way to collect feedback on any product (and we do regularly perform user research). However, because of the time and resources involved in true UX testing, we are looking for other ways to validate the UX of our product in a more efficient, expedited way.
We are wanting to automate some task scripts to collect metrics such as success/failure rate, errors/ error messages triggered, time on task, etc. A huge bonus is being able to implement human factors in the script, such as familiarity with the system, age, accessibility variables, etc. (the exact data for these human factors would be based off a large sampling of our user base).
Does anyone have any tools or tests they have used to collect automated UX KPIs? Can anyone think of a way to embed human factors into these tests?
Thanks in advance for any thoughts!