Literature Reviews — A11y Paradise

Real-Time Captioning by Groups of Non-Experts

Walter Lasecki, Christopher Miller, Adam Sadilek, Andrew Abumoussa, Donato Borrello, Raja Kushalnagar, Jeffrey Bigham (2012) — UIST '12: Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology

This paper presents Legion:Scribe, an end-to-end system that enables groups of non-expert typists to collectively produce real-time captions for deaf and hard of hearing (DHH) people, offering a cheaper and more available alternative to professional …

ASL-STEM Forum: Enabling Sign Language to Grow Through Online Collaboration

Anna C. Cavender, Daniel S. Otero, Jeffrey P. Bigham, Richard E. Ladner (2010) — CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper presents the ASL-STEM Forum, the first online video-based collaboration tool designed to help expand American Sign Language (ASL) vocabulary for Science, Technology, Engineering, and Mathematics (STEM) fields. The paper addresses a signifi…

Crowdsourcing Subjective Fashion Advice Using VizWiz: Challenges and Opportunities

Michele A. Burton, Erin Brady, Robin Brewer, Callie Neylan, Jeffrey P. Bigham, Amy Hurst (2012) — ASSETS '12: Proceedings of the 14th International ACM SIGACCESS Conference on Computers and Accessibility

This paper investigates the accessibility barriers that fashion and clothing present to people with vision impairments, and explores whether crowdsourcing through VizWiz can provide useful subjective fashion advice. The research is grounded in the re…

Using Real-time Feedback to Improve Visual Question Answering

Yu Zhong, Phyo Thiha, Grant He, Walter Lasecki, Jeffrey Bigham (2012) — CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing Systems

This work-in-progress paper introduces Legion:View, a system that extends the VizWiz model of crowd-powered visual question answering by adding a real-time feedback loop between blind users and crowd workers. The original VizWiz allowed blind users t…

Visual Challenges in the Everyday Lives of Blind People

Erin Brady, Meredith Ringel Morris, Yu Zhong, Samuel White, Jeffrey P. Bigham (2013) — CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

This paper presents the findings of a year-long large-scale study of VizWiz Social, an iPhone application that allows blind users to take a photograph, record a spoken question about it, and receive answers from crowd workers or social contacts withi…

Chorus: A Crowd-Powered Conversational Assistant

Walter S. Lasecki, Rachel Wesley, Jeffrey Nichols, Anand Kulkarni, James F. Allen, Jeffrey P. Bigham (2013) — UIST '13: Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

This paper presents Chorus, a crowd-powered conversational assistant that enables users to hold natural, continuous conversations with what appears to be a single partner, but is actually backed by multiple crowd workers operating in real-time. The s…

Adaptive Time Windows for Real-Time Crowd Captioning

Matthew J. Murphy, Christopher D. Miller, Walter S. Lasecki, Jeffrey P. Bigham (2013) — CHI EA '13: CHI '13 Extended Abstracts on Human Factors in Computing Systems

This paper addresses a key barrier to real-time captioning access for deaf and hard of hearing people: the high cost of professional stenographers, who can charge up to $200 per hour. Building on the Legion:Scribe system, which demonstrated that grou…

WearWrite: Crowd-Assisted Writing from Smartwatches

Michael Nebeling, Alexandra To, Anhong Guo, Adrian A. de Freitas, Jaime Teevan, Steven P. Dow, Jeffrey P. Bigham (2016) — Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI 2016)

WearWrite is a system that enables users to write documents from their smartwatches by leveraging crowd workers to translate ideas into text. The system addresses the fundamental limitation that smartwatches have severely constrained input/output — t…

Answering Visual Questions with Conversational Crowd Assistants

Walter S. Lasecki, Phyo Thiha, Yu Zhong, Erin Brady, Jeffrey P. Bigham (2013) — Proceedings of the 15th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2013)

This paper introduces Chorus:View, a system that enables blind users to get visual questions answered through continuous conversational interaction with multiple crowd workers viewing a live video stream from the user's mobile device. The system addr…

Real-Time Crowd Labeling for Deployable Activity Recognition

Walter S. Lasecki, Young Chol Song, Henry Kautz, Jeffrey P. Bigham (2013) — Proceedings of the 2013 Conference on Computer Supported Cooperative Work (CSCW 2013)

Legion:AR is a system that provides deployable activity recognition by combining real-time crowd labeling with automatic recognition using Hidden Markov Models (HMMs). The system addresses a critical limitation of current activity recognition: automa…