Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• A Conversational Interface to Web Automation

  Tessa Lau, Julian Cerruti, Guillermo Manzato, Mateo Bengualid, Jeffrey P. Bigham, Jeffrey Nichols (2010) — UIST '10: Proceedings of the 23rd Annual ACM Symposium on User Interface Software and Technology

  This paper presents CoCo (CoScripter Concierge), a system that automates web tasks on a user's behalf through short textual commands delivered via low-bandwidth channels such as Twitter, SMS, email, or a command line. Given a natural language command…

  • web automation
  • conversational interfaces
  • natural language
  • intelligent assistants
  • programming by demonstration
  • task automation

• Trailblazer: Enabling Blind Users to Blaze Trails Through the Web

  Jeffrey P. Bigham, Tessa Lau, Jeffrey Nichols (2009) — IUI '09: Proceedings of the 14th International Conference on Intelligent User Interfaces

  This paper introduces TrailBlazer, a system designed to help blind web users complete tasks more efficiently by providing step-by-step guidance through web pages. The core problem it addresses is that blind users relying on screen readers must often …

  • screen readers
  • blind users
  • web accessibility
  • non-visual interfaces
  • programming by demonstration
  • task guidance
  • intelligent user interfaces

• Automatically Generating and Improving Voice Command Interface from Operation Sequences on Smartphones

  Lihang Pan, Chun Yu, JiaHui Li, Tian Huang, Xiaojun Bi, Yuanchun Shi (2022) — Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems

  This paper presents AutoVCI, a system that automatically generates voice command interfaces (VCIs) for smartphone tasks from recorded touch operation sequences, enabling hands-free and eyes-free interaction without requiring programming expertise, co…

  • voice command interface
  • mobile accessibility
  • speech recognition
  • natural language understanding
  • programming by demonstration
  • smartphone automation
  • machine learning
  • GUI accessibility

• Complexities of Practical Web Automation

  Yury Puzis, Yevgen Borodin, I. V. Ramakrishnan (2015) — Proceedings of the 12th International Web for All Conference (W4A)

  This paper systematizes and analyzes the complexities involved in building practical, usable, and accessible web automation systems, drawing on published literature and the authors' years of experience developing automation tools for visually impaire…

  • web automation
  • screen readers
  • visual impairment
  • non-visual browsing
  • assistive technology
  • macros
  • programming by demonstration
  • cognitive load