Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
20 results found tagged captions.
-
FAME: Exploring Expressive Facial Avatars for Lyrical and Non-Lyrical Music Visualization for d/Deaf Individuals
This CHI 2026 paper investigates whether expressive facial avatars can carry the emotional and structural richness of music — rhythm, pitch, melody, lyrics, and emotion — to d/Deaf and Hard of Hearing (DHH) audiences in ways that captions and abstrac…
-
Like, Comment & Caption: A Decade of Social Media Video Caption Research (2015-2025)
This CHI 2026 paper is a systematic literature review of 36 peer-reviewed studies on Social Media Video Captions (SMVC) published between 2015 and 2025, spanning HCI, accessibility, media studies, education, and language learning. The authors use 'SM…
-
μCap: Instrumental Music Captions for Deaf and Hard-of-Hearing Individuals
Ahn and colleagues introduce μCap (Music Captions), an automatic captioning system that makes instrumental music accessible to Deaf and Hard-of-Hearing (DHH) audiences by producing time-aligned, non-lexical textual renderings — syllable-like strings …
-
Usability Evaluation of Captions for People Who Are Deaf or Hard of Hearing
This is a SIGACCESS Newsletter article summarizing a line of research by Kafle and Huenerfauth on building a caption-quality evaluation metric that actually reflects the experience of Deaf and Hard-of-Hearing (DHH) readers — rather than simply counti…
-
Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers
This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly…
-
Remotely Co-Designing Features for Communication Applications using Automatic Captioning with Deaf and Hearing Pairs
This CHI 2022 paper addresses two intertwined problems. First, methodologically, how can co-design research involving both Deaf/Hard-of-Hearing (DHH) and hearing participants be conducted remotely during and beyond COVID-19, when in-person sessions a…
-
Deaf Individuals' Views on Speaking Behaviors of Hearing Peers when Using an Automatic Captioning App
This CHI 2020 Late-Breaking Work paper investigates what behaviors hearing speakers should ideally exhibit when holding in-person conversations with Deaf or deaf people using an Automatic Speech Recognition (ASR) captioning app on a mobile device. Th…
-
Tactile Emotions: Multimodal Affective Captioning with Haptics Improves Narrative Engagement for d/Deaf and Hard-of-Hearing Viewers
This paper explores a multimodal approach to affective captioning — captions that convey not just the words a speaker says but the emotional dimensions of their voice — for d/Deaf and Hard-of-Hearing (dhh) viewers. Prior work has shown that typograph…
-
AVD-LV: An Accessible Player for Captioned STEM Videos
This demo paper presents AVD-LV (Accessible View Device interface for Low Vision), a Chrome browser extension that enhances YouTube lecture video accessibility for deaf and low vision (DLV) viewers. The core problem is that captioned videos require D…
-
Deaf and Hard-of-hearing Users Evaluating Designs for Highlighting Key Words in Educational Lecture Videos
This empirical study investigates design preferences for keyword highlighting in video captions among Deaf and Hard of Hearing (DHH) users. While style guides like the APA Publication Manual and Chicago Manual of Style provide recommendations for hig…