Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
161 results found tagged computer vision.
-
TouchPilot: Designing a Guidance System that Assists Blind People in Learning Complex 3D Structures
This paper introduces TouchPilot, a step-by-step guidance system designed to help blind people independently learn complex 3D structures through interactive 3D printed models (I3Ms). While existing I3Ms allow blind users to trigger audio labels by po…
-
What do Blind and Low-Vision People Really Want from Assistive Smart Devices? Comparison of the Literature with a Focus Study
This paper investigates whether the tasks and devices explored by researchers developing AI-based assistive smart devices actually align with what blind and low-vision (BLV) people want. The authors conducted a three-part study combining a scoping li…
-
The Sem-Lex Benchmark: Modeling ASL Signs and their Phonemes
This paper introduces the Sem-Lex Benchmark, the largest curated dataset of its kind for American Sign Language (ASL) isolated sign recognition, containing over 84,000 videos of isolated sign productions from 41 deaf ASL signers. The dataset addresse…
-
Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People who are Blind or Low Vision
This paper from Microsoft Research presents Find My Things, one of the first fully realized end-to-end teachable AI applications for accessibility. The app allows people who are blind or low vision to teach their phone to recognize personal objects —…
-
A Demonstration of RASSAR: Room Accessibility and Safety Scanning in Augmented Reality
This demo paper introduces RASSAR (Room Accessibility and Safety Scanning in Augmented Reality), a mobile AR application that semi-automatically identifies, localizes, and visualizes indoor accessibility and safety issues using iPhone LiDAR sensors a…
-
Case Study: In-the-Field Accessibility Information Collection Using Gamification
This study introduces and evaluates a crowdsourcing platform designed to collect real-world accessibility information for constructing accessibility maps that support people with mobility disabilities. Accessibility maps are critical for safe navigat…
-
ImageExplorer Deployment: Understanding Text-Based and Touch-Based Image Exploration in the Wild
This paper presents the real-world deployment and evaluation of ImageExplorer, an iOS application that enables blind and low-vision users to explore images through two complementary modalities: text-based sequential exploration and touch-based spatia…
-
Using Convolutional Neural Networks for Visual Sign Language Recognition: Towards a system that provides instant feedback to learners of sign language
This short paper presents a prototype system that uses computer vision and a convolutional neural network (CNN) to recognize finger-spelled letters in British Sign Language (BSL), providing real-time feedback to learners. The system addresses a gap i…
-
Exploring Object Status Recognition for Recipe Progress Tracking in Non-Visual Cooking
This paper presents OSCAR (Object Status Context Awareness for Recipes), a technical pipeline that uses object status recognition—tracking the condition and transformation of ingredients and tools—to support recipe progress tracking for blind and low…
-
FocusView: Understanding and Customizing Informational Video Watching Experiences for Viewers with ADHD
This paper presents FocusView, an AI-powered video customization interface designed to help viewers with ADHD reduce distractions and maintain focus when watching informational videos. The research addresses the critical gap that while videos have be…