Questions tagged [evaluation]
This tag should be used for research evaluation questions
28 questions
0
votes
1
answer
17
views
Should you train participants during a formative evaluation?
When running a formative evaluation during the development process of a medical product (requires FDA clearance), should you provide any training to the participants before asking them to go through ...
0
votes
2
answers
55
views
Heuristic evaluation definition
I'm having an issue within my company.
We are building a UX playbook within the guild to keep consistency.
We are dealing right now with heuristic evaluation.
My leader wants do analyse only the 10 ...
1
vote
2
answers
115
views
Questionnaire for Small Sample Studies (5-7 users)
I am currently working on my thesis and am working on conducting an user research about chatbot experience with real users. Currently, I will test three different chatbot prototypes to test:
(1) For ...
- 11
0
votes
1
answer
32
views
Using Statistical Analysis and Tests on Users' data
I have a Master's degree in HCI. As a master's student, I had to pass some Stats courses at university. Within these courses, we were familiarized with tests like T-Tests and we were required to run ...
0
votes
1
answer
68
views
Steps for Website evaluation
I've been asked to do a website review and evaluation and suggest improvements.
The website is live and running, what should the steps be for this kind of work?
- 71
1
vote
1
answer
803
views
Criteria for what qualifies as a heuristic violation?
I've been conducting a heuristic evaluation on a web application with roughly 15 evaluators, all of whom are single experts (i.e. familiar with the application but not usability experts). We're using ...
- 21
3
votes
1
answer
246
views
Task completion rate increased from 53% to 73% but still under the standard average of 78%
A tree testing conducted for a website navigation and the result was 53% then, we redesigned the information architecture and produced a new tree testing with the new navigation. The result improved ...
- 93
2
votes
1
answer
89
views
A method for consistency comparison of multiple products
Are there any good methods / tools / templates for evaluating the consistency of multiple websites from one product family in terms of UI components, patterns, button placements, labelling, date ...
- 689
1
vote
1
answer
205
views
SUS evaluation on the same system but different sections and participants
Would it be okay to use 2 SUS scores to come up with a single score in the case I explain below:
I conducted a user testing for a banking mobile app, the app under investigation has lots of tasks ...
- 93
0
votes
2
answers
185
views
User testing, novice outperforms experts
Happy new year to all! Recently we are working on the findability of content elements by running tree testing. At the results, we encountered that novice users are better at finding correct options ...
- 93
1
vote
1
answer
189
views
Which heuristics criteria justifies redirecting the user to a 404 redirect page?
Assuming UX experts are familiar with the Bastien & Scarpin Heuristics Criteria, how does it classify the behavior of user clicking in a link and being redirect to a 404 page?
I'm struggling to ...
- 111
1
vote
4
answers
4k
views
How to clearly distinguish a login page from a register page?
I recently conducted a series of user experience evaluation sessions for a prototype application that had been developed with the goal of capturing user experience bottlenecks and other issues.
Each ...
- 113
0
votes
1
answer
67
views
Have to quantify ux? [duplicate]
I was assigned by the lecturer to conduct a user experience evaluation on an existing website. Then in the question, he asked us how you quantify user experience and heuristic that you will be using ...
- 3
4
votes
2
answers
196
views
How to evaluate a console application?
I have to perform an end-user evaluation on a console application.
the application is a sort of a software library, i.e., a series of commands that a programmer can use to perform some specific tasks
...
- 171
3
votes
3
answers
178
views
Validate user experience for expert users
I am a computer scientist, and I have contributed in building a strongly technical solution (cloud-based, scalable) for the computation of large data volumes in short time. Such platform offers ...
- 171
3
votes
2
answers
242
views
What are the best methods to test/validate a set of user interface design guidelines for a concept product that does not exist yet?
As part of my PhD, I designed a set of user interface design guidelines for an in-vehicle device. This device does not exist at the moment. What would be the best methods to test/validate these ...
2
votes
3
answers
556
views
How to setup the Usability Test and how to evaluate the results?
I am new to UX and trying to learn all the methodologies. I am now learning and understand how setup the Usability Tests and how to hen evaluate the results.
Can you please share some of your real ...
- 291
23
votes
8
answers
950
views
Getting a dev team to understand the importance of small details
As we know, in UX design it is important to care about pixel level details in addition to the big picture. Meaning that all UI elements are perfectly aligned, correct colour, etc.
However, from time ...
- 567
1
vote
2
answers
103
views
Sharing UX findings with the development team [closed]
We have a small dev team where I am the sole UX designer. So as everyone knows, we can identify UX design issues with various method, e.g., via heuristic evaluation and usability testing. Furthermore, ...
- 567
1
vote
7
answers
276
views
Should I ask the user to complete the task as fast as she can in user test?
I need to evaluate insurance auto quote process which has 3-4 pages of forms to fill. I have designed a prototype with two variations and want to test which of them is easier to use.
So I plan to ...
- 11.6k
2
votes
1
answer
62
views
A concrete approach to user evaluation
I am conducting a research in which I plan to rely on user-centered design methodology. If my understanding of this methodology is correct, it is important to have many iterations in the end of which ...
- 121
6
votes
2
answers
1k
views
When evaluating prototypes, how can I ensure the user evaluates specific aspects instead of the product/design as a whole?
I've heard about this issue from different people and written sources. When building prototypes one would like evaluation from users. One type of evaluation is, for each functionality, whether it is ...
- 409
2
votes
2
answers
292
views
Lab-Based vs. Field-based study for mobile (location-based) application
Hopefully I've found the right corner of StackExchange...
Coming to my point, a few information are needed. The following paragraph is nothing more than an introduction, but might be important for my ...
- 121
10
votes
5
answers
450
views
Is conducting a UX review while drunk a good idea?
http://theuserisdrunk.com/
A system should be easy to use.
My question: will a drunk user be more error prone and likely to expose the flaws in a website more easily?
- 8,270
3
votes
2
answers
3k
views
Reference for words that can be used to describe how users 'feel' or 'experience' when it comes to qualitative user experience evaluation?
I remember reading about some study for the Microsoft Ribbon design (this could be wrong) where a list of words were provided to the user to describe what they feel or experience either when they see ...
- 27.7k
1
vote
1
answer
59
views
Is it appropriate to discussed the proposed usability method in literature review or in methodology chapter?
I need some clarification on where to put the proposed usability evaluation method in my thesis. Is it appropriate to discuss it in literature review chapter or in research methodology chapter of my ...
- 11
1
vote
2
answers
781
views
Involving end users with UAT for software development
I just had a project manager and developers request we use end-users for User Acceptance Testing. They want end-users to try and break the software prior to launch. This really caught me off guard. ...
- 11
1
vote
1
answer
83
views
How to evaluate the impact or satisfaction of users for user-driven design decisions?
One of the progression of user-centric design methodologies is to engage the end-users in design decisions rather than just using them as a feedback mechanism. This is supported by many common tools (...
- 27.7k