Glossary
Searchable terminology from accessibility, web standards, and related fields.
55 results found in Evaluation Methods.
- FaceReader (Noldus FaceReader)
- A commercial facial-expression recognition software (developed by Noldus) that uses computer vision and deep learning to automatically classify faces into basic emotions (neutral, happy, sad, angry, s…
- Feasibility Study (Feasibility Trial, Pilot Study)
- A feasibility study is a small-scale investigation conducted before a full-scale trial to determine whether a planned intervention or system can be delivered as intended in its real-world setting. Fea…
- Friedman Test (Friedman Rank Test)
- The Friedman test is a non-parametric statistical test used to detect differences across three or more related samples - for example, the same participants rating three interface conditions. It ranks …
- Gold-Standard Evaluation (Gold Standard, Reference Standard Evaluation)
- An evaluation methodology in natural language processing and generation where system output is compared against a set of pre-established correct or ideal responses. In text-based systems, gold-standar…
- Haptic Experience Model (HX Model, HX)
- A framework proposed by Kim and Schneider for evaluating user experience with haptic technologies along five perceptual-experiential dimensions: autotelics (the pleasantness of the sensation), realism…
- Heuristic Walkthrough (Heuristic walk-through)
- A usability evaluation method proposed by Andrew Sears (1997) that combines scenario-based cognitive walkthrough with heuristic evaluation. Evaluators work through realistic user tasks using a priorit…
- Index of Difficulty (ID, Fitts ID)
- The Index of Difficulty (ID) is the central quantity in Fitts' law that captures how hard a rapid aimed pointing movement is, computed as log₂(A/W + 1) in the Shannon formulation, where A is the ampli…
- Internal Reliability (Internal Consistency)
- A psychometric property that measures whether all items in a questionnaire or instrument contribute consistently to the overall score. It is commonly assessed using Cronbach's alpha, where values of 0…
- Interpersonal Reactivity Index (IRI)
- A widely used multidimensional self-report measure of empathy developed by Mark H. Davis in 1980. The instrument contains four seven-item subscales: perspective taking (the tendency to adopt another's…
- LIME (Local Interpretable Model-agnostic Explanations)
- An explainable AI technique, introduced by Ribeiro et al. in 2016, that approximates any black-box model's behaviour around a single prediction by fitting a simple interpretable model (usually sparse …
- LLM-as-Judge (LLM as a Judge, Model-as-Judge)
- An evaluation methodology in which a large language model is prompted to assess the quality of some artifact — generated text, code, a UI, or a response from another model — according to a structured …
- Literacy Bias (Literacy bias of a metric)
- In accessibility research methodology, a literacy bias describes the phenomenon where an evaluation metric systematically produces different scores for participants with different reading-literacy lev…
- N-back Task (N-back, 2-back Task)
- A working-memory paradigm in which participants view or hear a sequence of stimuli (letters, digits, positions) and, on each trial, respond when the current stimulus matches the one presented N steps …
- NGOMSL (Natural GOMS Language)
- A structured notation for writing GOMS (Goals, Operators, Methods, Selection rules) models in a program-like form that is readable by humans. NGOMSL was developed by David Kieras as a more formal vari…
- OPTIMAL-EM (Optimised Evaluation Methodology)
- A web accessibility evaluation methodology proposed by Hambley, Yesilada, Vigo, and Harper to complement the W3C's WCAG-EM by providing a statistically grounded, complexity-driven method for selecting…
- Pluralistic Walkthrough (Pluralistic Usability Walkthrough)
- A group usability inspection method, introduced by Randolph Bias in 1994, in which users, developers, and usability specialists step through a task scenario together, each writing down the actions the…
- PrEmo (Product Emotion Measurement Instrument)
- A non-verbal self-report tool for measuring emotional responses, developed by Pieter Desmet. PrEmo presents users with 14 cartoon-like icons representing seven positive emotions (joy, admiration, prid…
- Psychometric Evaluation (Psychometric Validation, Psychometric Analysis)
- The process of assessing whether a measurement instrument (such as a questionnaire or survey) possesses desirable statistical properties including validity, reliability, and consistency. In accessibil…
- Quality of Perception (QoP)
- An evaluation framework from the multimedia-accessibility research literature for measuring how well a user can understand and use a media presentation, combining objective comprehension metrics (e.g.…
- SARI (System output Against References and against the Input sentence)
- An automatic evaluation metric for text simplification systems that compares a system’s output against both the original input sentence and a set of human-written simplification references, rewarding …