I'm making a user study. Users had to perform the same task 10 times. I've recorded the completion times of each task. How could I calculate the UI's efficiency based on this data? Does anyone know the correct formula to do that? Preferably with references. Thanks!
I need to calculate the efficiency time. The user always starts from 0 efficiency and then through time (number of tries) efficiency increases and efficiency time decreases both logarithmically reaching its final value.
I've calculated the perfect efficiency time using the Keystroke Level Modeling and it's, let's say 6s. Which means in perfect case scenario a "robot" user will complete this task in 6s. But since I'm working with people the efficiency time differs from user to user and I need to acquire those efficiency time values to average them and compare with the robot user efficiency time.
So I have the data for 10 tries of the same task and I need to get this efficiency time value for each user to sum up the experiments. I reckon there should be a statistical tool to calculate this, and this is what I'm looking for.
I've found this link with a statistical approach to get efficiency over time, overall relative efficiency, expert relative efficiency. The problem it has absolutely no references whatsoever so I'm not sure I can use that as it is. Did some of you maybe faced this approach before and could introduce some references.
Please ask if you need more clarification.