Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
138 results found tagged machine learning.
-
Zensors: Adaptive, Rapidly Deployable, Human-Intelligent Sensor Feeds
Zensors presents a novel sensing platform that combines real-time human intelligence from online crowd workers with machine learning to create adaptive, rapidly deployable intelligent sensors. The system addresses a fundamental gap in smart environme…
-
Screening Dyslexia for English Using HCI Measures and Machine Learning
This paper presents a machine learning approach to screening for dyslexia in English speakers by analyzing how users interact with a linguistic computer-based game called Dytective. More than 10% of the population has dyslexia, but most are diagnosed…
-
App Usage Predicts Cognitive Ability in Older Adults
This paper investigates how older adults use smartphones differently from younger adults and whether those differences can be explained by cognitive function. The researchers collected three months of iPhone usage data from 84 healthy older adults (a…
-
Screen Recognition: Creating Accessibility Metadata for Mobile Applications from Pixels
This paper from Apple introduces Screen Recognition, a system that automatically generates accessibility metadata for mobile apps by analyzing their visual pixels, enabling screen readers to work with apps that lack proper developer-provided accessib…
-
Crowd-AI Camera Sensing in the Real World
This paper presents Zensors++, a hybrid crowd-AI camera sensing system that allows users to point a networked camera at a scene, define a natural language question about it (such as "Is the coffee machine in use?" or "How many people are in the room?…
-
People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges
This paper explores whether people with visual impairments can train their own personalized object recognition systems using a smartphone camera and a small number of example photos. The authors address a fundamental limitation of existing object rec…
-
Automated Class Discovery and One-Shot Interactions for Acoustic Activity Recognition
This paper presents Listen Learner, an end-to-end system for acoustic activity recognition that automatically discovers and learns to classify environmental sounds with minimal user effort. Traditional approaches to sound recognition face a tradeoff:…
-
Towards Automated Accessibility Report Generation for Mobile Apps
This paper presents a system for automatically generating whole-app accessibility reports for mobile apps, addressing key limitations of existing accessibility scanning tools. The work begins with formative interviews with eight accessibility QA prof…
-
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
This paper introduces screen parsing, the task of predicting UI elements and their hierarchical relationships from a screenshot alone. While prior work could detect individual UI elements on a screen (element detection), those approaches produced fla…
-
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
This paper introduces WebUI, a large-scale dataset of approximately 400,000 web pages automatically crawled and paired with visual, semantic, and stylistic metadata extracted from the browser engine. The dataset addresses a critical bottleneck in UI …