Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Modeling Word Importance in Conversational Transcripts: Toward improved live captioning for Deaf and hard of hearing viewers

  Akhter Al Amin, Saad Hassan, Matt Huenerfauth, Cecilia O. Alm (2023) — Proceedings of the 20th International Web for All Conference (W4A)

  This paper investigates how to model word importance in conversational transcripts to improve live captioning quality for Deaf and hard of hearing (DHH) viewers. Live captions generated by automatic speech recognition (ASR) systems inevitably contain…

  • live captioning
  • deaf and hard of hearing
  • automatic speech recognition
  • word importance
  • natural language processing
  • caption quality metrics

• Predicting the Understandability of Imperfect English Captions for People Who Are Deaf or Hard of Hearing

  Sushant Kafle, Matt Huenerfauth (2019) — ACM Transactions on Accessible Computing (TACCESS)

  This paper tackles a fundamental measurement problem in ASR-based captioning for Deaf and Hard-of-Hearing (DHH) users: the standard Word Error Rate (WER) metric has little correlation with how DHH users actually perceive caption quality. WER treats a…

  • automatic speech recognition
  • captioning
  • deaf and hard of hearing
  • evaluation metrics
  • word error rate
  • caption quality
  • word importance
  • semantic distance
  • NLP