Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
161 results found tagged computer vision.
-
Hacking Blind Navigation
This workshop summary describes a one-day CHI 2019 workshop designed to bring together researchers from multiple disciplines working on assistive navigation technologies for blind people. The organizers — experts from Carnegie Mellon University, Univ…
-
Crowd-AI Camera Sensing in the Real World
This paper presents Zensors++, a hybrid crowd-AI camera sensing system that allows users to point a networked camera at a scene, define a natural language question about it (such as "Is the coffee machine in use?" or "How many people are in the room?…
-
People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges
This paper explores whether people with visual impairments can train their own personalized object recognition systems using a smartphone camera and a small number of example photos. The authors address a fundamental limitation of existing object rec…
-
Twitter A11y: A Browser Extension to Make Twitter Images Accessible
This paper presents Twitter A11y, a browser extension designed to address the widespread lack of alternative text on images posted to Twitter. The authors note that while around 12% of Twitter content consists of images, only 0.1% of those images inc…
-
StateLens: A Reverse Engineering Solution for Making Existing Dynamic Touchscreens Accessible
This paper presents StateLens, a three-part system that makes existing dynamic touchscreen interfaces accessible to blind users without requiring any modification to the touchscreen hardware or software. Blind people routinely encounter inaccessible …
-
Towards Automated Accessibility Report Generation for Mobile Apps
This paper presents a system for automatically generating whole-app accessibility reports for mobile apps, addressing key limitations of existing accessibility scanning tools. The work begins with formative interviews with eight accessibility QA prof…
-
Screen Parsing: Towards Reverse Engineering of UI Models from Screenshots
This paper introduces screen parsing, the task of predicting UI elements and their hierarchical relationships from a screenshot alone. While prior work could detect individual UI elements on a screen (element detection), those approaches produced fla…
-
WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semantics
This paper introduces WebUI, a large-scale dataset of approximately 400,000 web pages automatically crawled and paired with visual, semantic, and stylistic metadata extracted from the browser engine. The dataset addresses a critical bottleneck in UI …
-
Never-ending Learning of User Interfaces
This paper introduces the Never-ending UI Learner, an automated system that continuously crawls real mobile applications to learn semantic properties of user interfaces. The system addresses a fundamental limitation of current approaches to UI unders…
-
UIClip: A Data-driven Model for Assessing User Interface Design
This paper introduces UIClip, a computational model that automatically assesses UI design quality and visual relevance from a screenshot and natural language description. Built on OpenAI's CLIP B/32 architecture (151 million parameters), UIClip is fi…