Inspection-based Evaluations
Gilbert Cockton and Alan Woolrych

1. Usability, Inspection and Complementary Evaluation Methods
   • Defining Usability: Implications for Evaluation
   • The Phases of Usability Inspection
     • Analyst Preparation
     • Candidate Problem Discovery
     • Confirmation and Elimination of Candidate Problems
   • Relation to other methods
     • Model-based Evaluations
     • User-based Evaluations
     • The Need for Inspection Methods
2. A Survey of Inspection Methods
   • Types of Inspection Method
     • Principles
     • Heuristics
     • Guidelines
     • Style Guide Conformance
     • Walkthroughs
     • Hybrid Methods
   • Principle-based Methods
     • Cognitively Motivated Principles (Cognitive Dimensions, ISO 9241/10)
     • Software Engineering Principles (York work, IFIP WG2.7 DPIS)
   • Heuristic-based Methods
     • Shneiderman's Golden Rules
     • Nielsen and Mohlich's Heuristics
   • Guideline-based Methods
     • Smith and Mosier
     • ISO 9241 Dialogue Style Guidelines
     • Vanderdonckt's Guideline Structures
   • Style Guide based Methods
     • CUA
     • Apple
     • Microsoft
   • Walkthrough-based Methods
     • Cognitive Walkthrough
     • Related Methods: Pluralistic Walkthrough, Cognitive Jogthrough
   • Hybrid Methods
     • Heuristic Walkthrough
   • A Framework for Comparing Methods
     • Level of Abstraction
     • Supporting Theories
     • Adoption and Evolution
3. Scoping and Assessing Inspection Methods
   • Pragmatic Assessments
     • Gray and Salzman's critique
     • Responses to Gray and Salzman
     • A Structured Approach to Inspection Method Assessment
       • Analyst training and preparation
       • Problem Reporting
       • Known Problem Set Construction
       • Problem Matching
       • Scoping and Assessment
     • A Survey of Inspection Method Assessment
       • Heuristic Evaluation
       • Cognitive Walkthrough
       • Cognitive Dimensions
       • Guidelines
     • Summary: The Need to Improve Method Assessment and Scoping
   • Conclusion
     • The PAC-AR Framework for Inspection Method Assessment
       • Support for Problem Discovery: Perceivability, Actionability and Constructability
       • Support for Confirmation and Elimination: Analyst Resources on Users, Interaction, Tasks, Domains, Applications and Design
     • Choosing an Inspection Method
       • Matching Methods to Development Contexts
       • Risk Management via complementary methods
     • Summary: The Nature, Role, Capabilities and Limitations of Inspection Methods