Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Deaf and Hard-of-hearing Users Evaluating Designs for Highlighting Key Words in Educational Lecture Videos

  Sushant Kafle, Becca Dingman, Matt Huenerfauth (2021) — ACM Transactions on Accessible Computing

  This empirical study investigates design preferences for keyword highlighting in video captions among Deaf and Hard of Hearing (DHH) users. While style guides like the APA Publication Manual and Chicago Manual of Style provide recommendations for hig…

  • deaf and hard of hearing
  • captions
  • captioning
  • video accessibility
  • text highlighting
  • educational accessibility
  • user study

• Tracked Speech-To-Text Display: Enhancing Accessibility and Readability of Real-Time Speech-To-Text

  Raja S. Kushalnagar, Gary W. Behm, Aaron W. Kelstone, Shareef Ali (2015) — ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This research addresses a subtle but significant barrier facing deaf and hard of hearing (DHH) students in educational settings: visual dispersion. While hearing students can simultaneously watch lecture visuals (slides, demonstrations, whiteboard) a…

  • deaf and hard of hearing
  • speech-to-text
  • CART
  • captioning
  • education
  • visual dispersion
  • classroom accessibility
  • real-time captioning
  • C-Print

• The Effects of Automatic Speech Recognition Quality on Human Transcription Latency

  Yashesh Gaur (2015) — ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This paper investigates a practical question for accessibility: when does providing automatic speech recognition (ASR) output help human captionists work faster, and when does it slow them down? Converting speech to text is fundamental for making aud…

  • deaf
  • hard of hearing
  • automatic speech recognition
  • ASR
  • captioning
  • crowdsourcing
  • transcription
  • human computation

• Improving Real-Time Captioning Experiences for Deaf and Hard of Hearing Students

  Saba Kawas, George Karalis, Tzu Wen, Richard E. Ladner (2016) — Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16)

  This paper takes a holistic, qualitative approach to understanding deaf and hard of hearing (DHH) university students' experiences with real-time captioning in mainstream classrooms, examining both human-based captioning (CART — Communication Access …

  • deaf and hard of hearing
  • real-time captioning
  • CART
  • automatic speech recognition
  • education
  • co-design
  • inclusive design
  • captioning
  • classroom accessibility

• Deaf and Hard-of-Hearing Perspectives on Imperfect Automatic Speech Recognition for Captioning One-on-One Meetings

  Larwan Berke, Christopher Caulfield, Matt Huenerfauth (2017) — Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17)

  This paper investigates whether and how to display word-level confidence information from Automatic Speech Recognition (ASR) systems in real-time captions for Deaf and Hard-of-Hearing (DHH) users during one-on-one meetings with hearing people. ASR en…

  • deaf accessibility
  • automatic speech recognition
  • captioning
  • communication
  • user research
  • deaf and hard of hearing
  • confidence display

• Evaluating the Usability of Automatically Generated Captions for People who are Deaf or Hard of Hearing

  Sushant Kafle, Matt Huenerfauth (2017) — Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17)

  This paper addresses a fundamental problem in automatic captioning for Deaf and Hard of Hearing (DHH) users: the standard metric used to evaluate automatic speech recognition (ASR) systems — Word Error Rate (WER) — poorly predicts how usable the resu…

  • captioning
  • automatic speech recognition
  • deaf and hard of hearing
  • evaluation methods
  • natural language processing
  • real-time captioning
  • metrics

• Behavioral Changes in Speakers who are Automatically Captioned in Meetings with Deaf or Hard-of-Hearing Peers

  Matthew Seita, Khaled Albusays, Sushant Kafle, Michael Stinson, Matt Huenerfauth (2018) — Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2018)

  This study from Rochester Institute of Technology investigates a largely unexplored question: how does using an ASR-based captioning tool in meetings with deaf or hard of hearing (DHH) colleagues change the speaking behavior of hearing participants? …

  • deaf and hard of hearing
  • automatic speech recognition
  • captioning
  • communication accessibility
  • speech behavior
  • workplace accessibility
  • ASR

• Accessibility for the HTML5 <video> element

  Silvia Pfeiffer, Conrad Parker (2009) — Proceedings of the 2009 International Cross-Disciplinary Conference on Web Accessibililty (W4A)

  This paper documents early efforts to standardize how subtitles, captions, and other accessibility data should be associated with the then-new HTML5 <video> element. Written in 2009 when Firefox, Opera, and Safari were just beginning to implement <vi…

  • video accessibility
  • HTML5
  • captioning
  • subtitles
  • web standards
  • timed text
  • open source
  • Ogg

• Towards collaborative annotation for video accessibility

  Pierre-Antoine Champin, Benoît Encelle, Nicholas W. D. Evans, Magali O.-Beldame, Yannick Prié, Raphaël Troncy (2010) — Proceedings of the 2010 International Cross Disciplinary Conference on Web Accessibility (W4A)

  This paper presents the ACAV (Collaborative Annotation for Video Accessibility) project, a French research initiative involving Dailymotion, the University of Lyon (LIRIS), and EURECOM, aimed at making web video accessible to blind and deaf users thr…

  • video accessibility
  • audio description
  • captioning
  • crowdsourcing
  • speech recognition
  • Braille
  • multimodal interaction
  • semantic web
  • collaborative annotation

• Web Educational Services for All: The APEINTA Project

  Ana Iglesias, Lourdes Moreno, Belén Ruiz, José Luis Pajares, Javier Jiménez, Juan Francisco López, Pablo Revuelta, Julián Hernández (2011) — Proceedings of the International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This paper presents APEINTA, a Spanish educational project from Carlos III University of Madrid and the Spanish Centre of Captioning and Audio Description (CESyA), aimed at providing inclusive education through three cloud-based web services. Started…

  • education accessibility
  • captioning
  • text-to-speech
  • deaf and hard of hearing
  • speech disability
  • cloud computing
  • inclusive education
  • automatic speech recognition