Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
26 results found tagged human computation.
-
WearMail: On-the-Go Access to Information in Your Email with a Privacy-Preserving Human Computation Workflow
WearMail is a conversational system that extracts specific information from a user's email via voice queries on wearable devices (such as smartwatches), using a novel privacy-preserving human computation workflow. The system addresses the challenge t…
-
Scribe: Deep Integration of Human and Machine Intelligence to Caption Speech in Real Time
Scribe is a system that provides on-demand, real-time captioning of live speech for deaf and hard of hearing (DHH) people by combining groups of non-expert human captionists with machine intelligence. The system addresses a critical accessibility gap…
-
Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds
Zensors presents a novel sensing platform that combines real-time human intelligence from online crowd workers with machine learning to create adaptive, rapidly deployable intelligent sensors. The system addresses a fundamental gap in smart environme…
-
The Design of Human-Powered Access Technology
This paper presents a comprehensive framework of 13 design dimensions for evaluating and comparing human-powered access technology — systems that use human assistance, facilitated by technology, to overcome accessibility barriers that automation alon…
-
Warping Time for More Effective Real-Time Crowdsourcing
This paper introduces TimeWarp, a technique that manipulates audio playback speed to improve crowd workers performance on real-time speech captioning. The core problem is that non-expert typists cannot keep up with natural speaking rates of 150-225 w…
-
Legion Scribe: Real-Time Captioning by Non-Experts
This demonstration paper presents Legion:Scribe, a crowd-powered captioning system that enables groups of 3-5 non-expert typists to collectively produce real-time captions with less than 5 seconds of latency. The system addresses the prohibitive cost…
-
Real-Time Captioning with the Crowd
This article presents Scribe, a crowdsourced real-time captioning system that allows groups of non-expert typists to collectively produce captions at the speed of natural speech — a task that normally requires highly trained professional stenographer…
-
Crowd-AI Camera Sensing in the Real World
This paper presents Zensors++, a hybrid crowd-AI camera sensing system that allows users to point a networked camera at a scene, define a natural language question about it (such as "Is the coffee machine in use?" or "How many people are in the room?…
-
Guiding Novice Web Workers in Making Image Descriptions Using Templates
This study compares two approaches for using non-expert crowdworkers to create accessible descriptions of STEM images (charts, graphs, diagrams) for people who are blind or have print-reading disabilities. The researchers tested Free-Response Image D…
-
The Effects of Automatic Speech Recognition Quality on Human Transcription Latency
This paper investigates a practical question for accessibility: when does providing automatic speech recognition (ASR) output help human captionists work faster, and when does it slow them down? Converting speech to text is fundamental for making aud…