Lecture 14 — Heuristic Evaluation - Why and How | HCI Course | Stanford University

Summary

The video introduces heuristic evaluation, a technique for identifying usability issues in software design. Created by Jakob Nielsen, it involves experts using a set of principles to critique a design, which can be applied at various stages of the design process. The method is cost-effective, quick to perform, and beneficial for catching severe problems, though it may generate false positives. The script explains the evaluation process, the importance of multiple evaluators, and how to use the findings to improve design, emphasizing the technique's value alongside other feedback methods.

Takeaways

• 🔍 Heuristic evaluation is a critique-based approach for identifying usability issues in software design, often using a set of principles or heuristics.
• 👥 It is valuable to receive peer critique at various stages of the design process, such as before user testing, redesigning, and before software release.
• 📈 Heuristic evaluation was created by Jakob Nielsen and is a cost-effective method for finding usability problems, with a high benefit-cost ratio.
• 📝 The technique involves having evaluators independently assess the design against a set of heuristics and then discuss their findings collectively.
• 🛠 It can be applied to both working user interfaces and sketches, making it compatible with rapid prototyping and low-fidelity designs.
• 🔑 Nielsen's 10 heuristics serve as a good starting point, but they can be customized or expanded based on the specific needs of the system being evaluated.
• 🤔 The process begins with setting clear goals, even if the findings might be unexpected, and involves giving evaluators tasks to perform with the design.
• 📊 Using multiple evaluators helps in finding a wider range of problems, with each evaluator potentially identifying unique issues.
• 📈 The benefit of adding more evaluators decreases over time, with a general recommendation of 3-5 evaluators for optimal results.
• 🚫 Heuristic evaluation might generate false positives that wouldn't occur in real user testing, which is why it's important to combine it with other methods.
• 📝 After evaluation, a debrief session with the design team is crucial for discussing the findings, estimating fix efforts, and brainstorming improvements.

Q & A

What is heuristic evaluation?

Heuristic evaluation is a technique for finding usability problems in a design, where evaluators use a set of principles or heuristics to identify issues in the user interface.

Who created heuristic evaluation?

Heuristic evaluation was created by Jakob Nielsen and colleagues about 20 years ago.

Why is heuristic evaluation valuable?

Heuristic evaluation is valuable because it allows for quick feedback on a design with a high return on investment, and it can be used with both working user interfaces and sketches.

What are some ideal stages to conduct heuristic evaluation in the design process?

Heuristic evaluation can be particularly valuable before user testing, before redesigning an application, when needing data to convince stakeholders, and before releasing software for final refinements.

What is the purpose of using multiple evaluators in heuristic evaluation?

Using multiple evaluators helps to find a wider range of problems due to the diversity of perspectives, which can increase the effectiveness of the evaluation.

What is the recommended number of evaluators for heuristic evaluation according to Jakob Nielsen?

Jakob Nielsen suggests that three to five evaluators tend to work well for heuristic evaluation, balancing the cost and the number of problems found.

How does heuristic evaluation compare to user testing in terms of speed and interpretation?

Heuristic evaluation is often faster than user testing as it requires less setup and the results are pre-interpreted, providing direct feedback on problems and solutions.

What are some potential drawbacks of heuristic evaluation compared to user testing?

Heuristic evaluation might generate false positives that wouldn't occur in a real user environment, whereas user testing is more accurate but can be more time-consuming and resource-intensive.

What is the significance of severity ratings in heuristic evaluation?

Severity ratings help prioritize which problems to fix first by considering the frequency, impact, and pervasiveness of the issues found during the evaluation.

How should evaluators report the problems they find during heuristic evaluation?

Evaluators should report problems specifically, relating them to one of the design heuristics, and provide detailed descriptions to help the design team understand and address the issues efficiently.

What is the final step in the heuristic evaluation process after identifying and rating problems?

The final step is to debrief with the design team to discuss the findings, estimate the effort required to fix issues, and brainstorm future design improvements.