Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Multiple View Perspectives: Improving Inclusiveness and Video Compression in Mainstream Classroom Recordings

  Raja S. Kushalnagar, Anna C. Cavender, Jehan-François Pâris (2010) — Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010)

  This paper presents Multiple View Perspectives (MVP), a system that captures and presents multiple focused video views of a classroom for deaf and hard of hearing (DHH) students. DHH students in mainstream classrooms face a fundamental visual attenti…

  • deaf and hard of hearing
  • lecture capture
  • video accessibility
  • classroom accessibility
  • sign language interpreting
  • captioning
  • visual attention
  • video compression
  • inclusive education

• AudioWiz: Nearly Real-Time Audio Transcriptions

  Samuel White (2010) — Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010)

  This student research paper presents AudioWiz, a mobile application that provides near-real-time transcriptions of both spoken words and environmental sounds for deaf and hard of hearing users. The author identifies a critical gap in existing automat…

  • deaf and hard of hearing
  • audio transcription
  • crowdsourcing
  • human computation
  • environmental sounds
  • sound awareness
  • mobile accessibility

• Online Quality Control for Real-Time Crowd Captioning

  Walter S. Lasecki, Jeffrey P. Bigham (2012) — Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012)

  This paper addresses quality control in Legion:Scribe, a system that provides real-time captioning by having multiple non-expert crowd workers simultaneously type what they hear, then automatically merging their partial transcriptions into a single c…

  • real-time captioning
  • crowdsourcing
  • deaf and hard of hearing
  • automatic speech recognition
  • human computation
  • quality control
  • CART

• Crowd Caption Correction (CCC)

  Rebecca Perkins Harrington, Gregg C. Vanderheiden (2013) — Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (Assets '13)

  This short paper presents Crowd Caption Correction (CCC), a feature that allows meeting participants or authorized third parties to correct errors in real-time captions during telecollaboration sessions. Captions are critical for deaf and hard of hea…

  • captioning
  • deaf and hard of hearing
  • crowdsourcing
  • telecollaboration
  • real-time captioning
  • universal design
  • open source
  • transcription
  • videoconferencing

• Real-Time Captioning by Groups of Non-Experts

  Walter Lasecki, Christopher Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, Jeffrey Bigham (2012) — UIST '12: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

  This paper presents Legion:Scribe, an end-to-end system that enables groups of non-expert typists to collectively produce real-time captions for deaf and hard of hearing (DHH) people, offering a cheaper and more available alternative to professional …

  • real-time captioning
  • crowdsourcing
  • deaf and hard of hearing
  • human computation
  • text alignment
  • CART alternatives
  • assistive technology
  • speech recognition

• ClassInFocus: Enabling Improved Visual Attention Strategies for Deaf and Hard of Hearing Students

  Anna C. Cavender, Jeffrey P. Bigham, Richard E. Ladner (2009) — Assets '09: Proceedings of the 11th International ACM SIGACCESS Conference on Computers and Accessibility

  This paper presents ClassInFocus, a system designed to help deaf and hard of hearing (DHH) students manage the demanding visual attention requirements of modern multi-modal classrooms. DHH students face a unique challenge: while hearing students can …

  • deaf and hard of hearing
  • classroom accessibility
  • visual attention
  • notifications
  • eye tracking
  • sign language interpretation
  • real-time captioning
  • education

• Adaptive Time Windows for Real-Time Crowd Captioning

  Matthew J. Murphy, Christopher D. Miller, Walter S. Lasecki, Jeffrey P. Bigham (2013) — CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

  This paper addresses a key barrier to real-time captioning access for deaf and hard of hearing people: the high cost of professional stenographers, who can charge up to $200 per hour. Building on the Legion:Scribe system, which demonstrated that grou…

  • real-time captioning
  • crowdsourcing
  • deaf and hard of hearing
  • assistive technology
  • human computation
  • CART alternatives

• Real-Time Captioning by Non-Experts with Legion Scribe

  Walter S. Lasecki, Christopher D. Miller, Raja Kushalnagar, Jeffrey P. Bigham (2013) — Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2013)

  This short paper introduces Legion Scribe (Scribe), a system that enables 3-5 non-expert typists to collectively caption speech in real time, achieving accuracy approaching that of a professional stenographer at 20-30% of the cost. The system address…

  • real-time captioning
  • deaf and hard of hearing
  • crowdsourcing
  • human computation
  • assistive technology
  • captioning

• Scribe: Deep Integration of Human and Machine Intelligence to Caption Speech in Real Time

  Walter S. Lasecki, Christopher D. Miller, Iftekhar Naim, Raja Kushalnagar, Adam Sadilek, Daniel Gildea, Jeffrey P. Bigham (2017) — Communications of the ACM

  Scribe is a system that provides on-demand, real-time captioning of live speech for deaf and hard of hearing (DHH) people by combining groups of non-expert human captionists with machine intelligence. The system addresses a critical accessibility gap…

  • real-time captioning
  • deaf and hard of hearing
  • crowdsourcing
  • human computation
  • speech recognition
  • assistive technology
  • captioning

• A Readability Evaluation of Real-Time Crowd Captions in the Classroom

  Raja S. Kushalnagar, Walter S. Lasecki, Jeffrey P. Bigham (2012) — Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2012)

  This paper evaluates the readability of real-time captions produced by three different approaches in a higher education classroom setting: professional CART (Communication Access Realtime Translation) captionists, automatic speech recognition (ASR), …

  • real-time captioning
  • deaf and hard of hearing
  • crowdsourcing
  • classroom accessibility
  • higher education
  • speech recognition