Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Warping Time for More Effective Real-Time Crowdsourcing

  Walter S. Lasecki, Christopher D. Miller, Jeffrey P. Bigham (2013) — Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI 2013)

  This paper introduces TimeWarp, a technique that manipulates audio playback speed to improve crowd workers performance on real-time speech captioning. The core problem is that non-expert typists cannot keep up with natural speaking rates of 150-225 w…

  • real-time captioning
  • crowdsourcing
  • deaf and hard of hearing
  • human computation
  • speech accessibility

• Legion Scribe: Real-Time Captioning by Non-Experts

  Walter S. Lasecki, Raja Kushalnagar, Jeffrey P. Bigham (2014) — ACM SIGACCESS Conference on Computers and Accessibility

  This demonstration paper presents Legion:Scribe, a crowd-powered captioning system that enables groups of 3-5 non-expert typists to collectively produce real-time captions with less than 5 seconds of latency. The system addresses the prohibitive cost…

  • real-time captioning
  • crowdsourcing
  • deaf and hard of hearing
  • speech-to-text
  • human computation
  • accessibility

• Real-Time Captioning with the Crowd

  Walter S. Lasecki, Jeffrey P. Bigham (2014) — Interactions

  This article presents Scribe, a crowdsourced real-time captioning system that allows groups of non-expert typists to collectively produce captions at the speed of natural speech — a task that normally requires highly trained professional stenographer…

  • real-time captioning
  • crowdsourcing
  • deaf and hard of hearing
  • speech-to-text
  • human computation
  • accessibility

• Real-Time Caption Challenge: C-Print

  Michael S. Stinson, Pamela Francis, Lisa B. Elliot, Donna Easton (2014) — Proceedings of the 16th International ACM SIGACCESS Conference on Computers & Accessibility (ASSETS '14)

  This demonstration paper presents C-Print, a typing-based real-time captioning system developed over 25 years by researchers at the National Technical Institute for the Deaf (NTID) at Rochester Institute of Technology. C-Print provides communication …

  • deaf and hard of hearing
  • real-time captioning
  • communication access
  • transcription
  • mobile accessibility
  • education

• Accessibility Evaluation of Classroom Captions

  Raja S. Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham (2014) — ACM Transactions on Accessible Computing

  This paper presents a comprehensive evaluation of real-time captioning approaches for classroom lectures, comparing Communication Access Realtime Translation (CART), Automatic Speech Recognition (ASR), and a novel collaborative captioning system call…

  • real-time captioning
  • deaf and hard of hearing
  • classroom accessibility
  • crowdsourcing
  • eye tracking
  • CART
  • ASR
  • caption readability

• Tracked Speech-To-Text Display: Enhancing Accessibility and Readability of Real-Time Speech-To-Text

  Raja S. Kushalnagar, Gary W. Behm, Aaron W. Kelstone, Shareef Ali (2015) — ASSETS '15: Proceedings of the 17th International ACM SIGACCESS Conference on Computers & Accessibility

  This research addresses a subtle but significant barrier facing deaf and hard of hearing (DHH) students in educational settings: visual dispersion. While hearing students can simultaneously watch lecture visuals (slides, demonstrations, whiteboard) a…

  • deaf and hard of hearing
  • speech-to-text
  • CART
  • captioning
  • education
  • visual dispersion
  • classroom accessibility
  • real-time captioning
  • C-Print

• Improving Real-Time Captioning Experiences for Deaf and Hard of Hearing Students

  Saba Kawas, George Karalis, Tzu Wen, Richard E. Ladner (2016) — Proceedings of the 18th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '16)

  This paper takes a holistic, qualitative approach to understanding deaf and hard of hearing (DHH) university students' experiences with real-time captioning in mainstream classrooms, examining both human-based captioning (CART — Communication Access …

  • deaf and hard of hearing
  • real-time captioning
  • CART
  • automatic speech recognition
  • education
  • co-design
  • inclusive design
  • captioning
  • classroom accessibility

• Evaluating the Usability of Automatically Generated Captions for People who are Deaf or Hard of Hearing

  Sushant Kafle, Matt Huenerfauth (2017) — Proceedings of the 19th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '17)

  This paper addresses a fundamental problem in automatic captioning for Deaf and Hard of Hearing (DHH) users: the standard metric used to evaluate automatic speech recognition (ASR) systems — Word Error Rate (WER) — poorly predicts how usable the resu…

  • captioning
  • automatic speech recognition
  • deaf and hard of hearing
  • evaluation methods
  • natural language processing
  • real-time captioning
  • metrics

• Towards Accessible Conversations in a Mobile Context for People who are Deaf and Hard of Hearing

  Dhruv Jain, Rachel Franz, Leah Findlater, Jackson Cannon, Raja Kushalnagar, Jon Froehlich (2018) — Proceedings of the 20th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '18)

  This paper presents two studies examining the communication needs of deaf and hard of hearing (DHH) people in mobile contexts (walking, transit, recreational activities) and the potential for head-mounted display (HMD) captions to address those needs…

  • deaf and hard of hearing
  • real-time captioning
  • augmented reality
  • head-mounted display
  • mobile accessibility
  • conversations
  • HoloLens
  • visual attention split

• Legion Scribe: Real-Time Captioning by the Non-Experts

  Walter S. Lasecki, Christopher D. Miller, Raja Kushalnagar, Jeffrey P. Bigham (2013) — Proceedings of the 10th International Cross-Disciplinary Conference on Web Accessibility (W4A)

  This demo paper introduces Legion Scribe, a system that enables real-time captioning of speech by harnessing 3-5 ordinary typists working simultaneously, rather than relying on expensive professional stenographers. Real-time captioning provides text …

  • captioning
  • deaf and hard of hearing
  • crowdsourcing
  • real-time captioning
  • communication accessibility
  • assistive technology
  • human computation