Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Eye Gaze Behaviour and Comprehension of Colour Commentary and Gameplay Captions of Live Fast-Paced Sports for Deaf and Hard of Hearing Television Viewers

  Somang Nam, Tatyana Kumarasamy, Maria Karam, Margot Whitfield, Evan Hibbard, Jenny Leung, Deborah Fels (2026) — ACM Transactions on Accessible Computing

  This ACM TACCESS study evaluates a novel captioning approach for live fast-paced sports broadcasting: 'Reduced Captioning' that displays only the colour commentary (opinions, context, analysis) and omits the verbatim play-by-play narration. The autho…

  • closed captioning
  • live captioning
  • broadcasting
  • sports
  • eye tracking
  • Deaf
  • Hard of Hearing
  • readability
  • cognitive accessibility
  • user study

• Watch It, Don't Imagine It: Creating a Better Caption-Occlusion Metric by Collecting More Ecologically Valid Judgments from DHH Viewers

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth (2022) — Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems (CHI '22)

  This CHI 2022 paper builds a better automated metric for the severity of caption-occlusion — the problem of closed captions blocking important on-screen visual content during television programming. DHH viewers consistently report that even perfectly…

  • captioning
  • captions
  • caption occlusion
  • deaf and hard of hearing
  • television accessibility
  • video accessibility
  • accessibility metrics
  • accessibility research
  • live captioning

• Who is speaking: Unpacking In-text Speaker Identification Preference of Viewers who are Deaf and Hard of Hearing while Watching Live Captioned Television Program

  Akhter Al Amin, Joseph Mendis, Raja Kushalnagar, Christian Vogler, Matt Huenerfauth (2023) — Proceedings of the 20th International Web for All Conference (W4A '23)

  This study systematically investigates how the number of speakers onscreen in live television programs affects Deaf and Hard of Hearing (DHH) viewers' preferences for different in-text speaker identification methods in captions. Live TV news and inte…

  • deaf and hard of hearing
  • captioning
  • live captioning
  • television accessibility
  • caption quality
  • caption customization
  • media accessibility
  • user preferences
  • Deaf community

• Understanding How Deaf and Hard of Hearing Viewers Visually Explore Captioned Live TV News

  Akhter Al Amin, Saad Hassan, Sooyeon Lee, Matt Huenerfauth (2023) — Proceedings of the 20th International Web for All Conference (W4A '23)

  This study investigates how Deaf and Hard of Hearing (DHH) viewers distribute their visual attention across different information regions on screen while watching captioned live television news. More than 360 million people worldwide are DHH, and man…

  • deaf and hard of hearing
  • captioning
  • eye tracking
  • television accessibility
  • caption placement
  • gaze behavior
  • live captioning
  • news consumption
  • attention
  • caption quality metrics

• Modeling Word Importance in Conversational Transcripts: Toward improved live captioning for Deaf and hard of hearing viewers

  Akhter Al Amin, Saad Hassan, Matt Huenerfauth, Cecilia O. Alm (2023) — Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates how to model word importance in conversational transcripts to improve live captioning quality for Deaf and hard of hearing (DHH) viewers. Live captions generated by automatic speech recognition (ASR) systems inevitably contain…

  • live captioning
  • deaf and hard of hearing
  • automatic speech recognition
  • word importance
  • natural language processing
  • caption quality metrics