Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Helping students keep up with real-time captions by pausing and highlighting

  Walter S. Lasecki, Raja Kushalnagar, Jeffrey P. Bigham (2014) — Proceedings of the 11th Web for All Conference (W4A)

  This paper addresses a fundamental problem with real-time captioning for deaf and hard of hearing (DHH) students: the mismatch between speaking rates (approximately 170 words per minute) and reading rates, which causes students to fall progressively …

  • deaf and hard of hearing
  • captioning
  • real-time captioning
  • education
  • inclusive classrooms
  • reading speed
  • gaze switching

• Evaluation of Real-time Captioning by Machine Recognition with Human Support

  Hironobu Takagi, Takashi Itoh, Kaoru Shinkawa (2015) — Proceedings of the 12th International Web for All Conference (W4A)

  This paper from IBM Research Tokyo investigates a hybrid approach to real-time captioning that combines Automated Speech Recognition (ASR) with human correction to make workplace meetings accessible for deaf and hard of hearing (DHH) employees. Profe…

  • real-time captioning
  • deaf and hard of hearing
  • automated speech recognition
  • workplace accessibility
  • Japanese
  • speech recognition
  • captioning

• Scopist: Building a Skill Ladder into Crowd Transcription

  Jeffrey P. Bigham, Kristin Williams, Nila Banerjee, John Zimmerman (2017) — Proceedings of the 14th International Web for All Conference (W4A)

  This paper introduces Scopist, a JavaScript application designed to teach crowd workers stenotype — a chording-based text entry method used by professional real-time captioners — while they perform audio transcription microtasks. The research address…

  • crowdsourcing
  • captioning
  • stenography
  • deaf accessibility
  • transcription
  • skill development
  • text entry
  • real-time captioning

• Access on Demand: Real-time, Multi-modal Accessibility for the Deaf and Hard-of-Hearing based on Augmented Reality

  Roshan Mathew, Brian Mak, Wendy Dannels (2022) — Proceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '22)

  This experience report documents two deaf researchers' hands-on evaluation of Access on Demand (AoD), an augmented reality application developed at Rochester Institute of Technology that delivers real-time captioning and American Sign Language (ASL) …

  • augmented reality
  • deaf and hard of hearing
  • smart glasses
  • captioning
  • sign language interpretation
  • assistive technology
  • wearable technology
  • real-time captioning
  • automatic speech recognition

• CARTGPT: Real-Time Correction of CART Captions Using Large Language Models

  Liang-Yuan Wu, Andrea Kleiver, Dhruv Jain (2025) — ASSETS 2025: 27th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper introduces CARTGPT, a real-time system that enhances Communication Access Realtime Translation (CART) captions by combining human-generated CART transcripts with automatic speech recognition (ASR) output and using GPT-4 to detect and corre…

  • deaf and hard of hearing
  • real-time captioning
  • CART
  • large language models
  • automatic speech recognition
  • caption accuracy
  • hybrid captioning