Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
46 results found tagged automatic speech recognition.
-
Modeling Word Importance in Conversational Transcripts: Toward improved live captioning for Deaf and hard of hearing viewers
This paper investigates how to model word importance in conversational transcripts to improve live captioning quality for Deaf and hard of hearing (DHH) viewers. Live captions generated by automatic speech recognition (ASR) systems inevitably contain…
-
Notification Designs for Influencing Hearing Speakers' Behaviors During Captioned Conversations Among Mixed DHH-Hearing Groups
This paper investigates notification system designs that prompt hearing speakers to adjust their speech behaviors (speaking slower, louder, or more clearly) during ASR-captioned videoconference conversations with Deaf and Hard of Hearing (DHH) partic…
-
CARTGPT: Real-Time Correction of CART Captions Using Large Language Models
This paper introduces CARTGPT, a real-time system that enhances Communication Access Realtime Translation (CART) captions by combining human-generated CART transcripts with automatic speech recognition (ASR) output and using GPT-4 to detect and corre…
-
Enhancing Accessibility through Correction of Speech Recognition Errors
This paper investigates methods for automatically correcting errors in speech recognition-generated captions of university lectures, aiming to improve accessibility for hearing-impaired students. The author notes that while ASR-based captioning can m…
-
Predicting the Understandability of Imperfect English Captions for People Who Are Deaf or Hard of Hearing
This paper tackles a fundamental measurement problem in ASR-based captioning for Deaf and Hard-of-Hearing (DHH) users: the standard Word Error Rate (WER) metric has little correlation with how DHH users actually perceive caption quality. WER treats a…
-
Artificial Intelligence Fairness in the Context of Accessibility Research on Intelligent Systems for People Who Are Deaf or Hard of Hearing
This paper from RIT's Center for Accessibility and Inclusion Research discusses AI fairness issues specifically through the lens of the authors' extensive research on intelligent systems for people who are Deaf or Hard of Hearing (DHH). The authors i…