Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
23 results found tagged object recognition.
-
"Hands On" Visual Recognition for Visually Impaired Users
This paper presents a collaborative visual recognition system designed to help blind or visually impaired (BVI) users identify specific product instances — distinguishing between brands, models, or types of objects that feel similar when handled. Whi…
-
Investigating Cursor-based Interactions to Support Non-Visual Exploration in the Real World
This paper from Google and Carnegie Mellon University defines and compares three cursor-based interaction techniques designed to help blind and low vision people attend to specific items within complex real-world visual scenes. While computer vision …
-
Marker-based image recognition of dynamic content for the visually impaired
This paper from IBM Research Brazil introduces a marker-based image recognition technique to help visually impaired people access information displayed on public panels and boards with fixed layouts but dynamic content — such as vending machines, spl…
-
Marker-Assisted Recognition of Dynamic Content in Public Spaces
This paper from IBM Research Brazil presents an image processing system that helps visually impaired and situationally disabled people (such as tourists in foreign countries) recognize dynamic content displayed on public information boards. The syste…
-
A TensorFlow-based Assistive Technology System for Users with Visual Impairments
This extended abstract presents a wearable computer vision system that uses deep learning to classify objects in a blind user’s surroundings and provide audio descriptions via text-to-speech. The system addresses a limitation of smartphone-based obje…
-
Closing the Gap: Designing for the Last-Few-Meters Wayfinding Problem for People with Visual Impairments
This paper comprehensively investigates the last-few-meters wayfinding problem — the gap between where GPS navigation ends (within approximately 5 meters of a destination) and where a person with visual impairment actually needs to arrive (the specif…
-
Revisiting Blind Photography in the Context of Teachable Object Recognizers
This paper introduces a real-time audio-haptic feedback system to help people with visual impairments frame objects in their smartphone camera when training teachable object recognizers. The challenge is that teachable recognizers — which let users t…
-
Blind Users Accessing Their Training Images in Teachable Object Recognizers
This paper introduces MYCam, an open-source iOS testbed application designed to help blind users build and improve personalized object recognizers. While teachable object recognizers allow users to train custom models by taking photos of objects they…
-
Understanding Personalized Accessibility through Teachable AI: Designing and Evaluating Find My Things for People who are Blind or Low Vision
This paper from Microsoft Research presents Find My Things, one of the first fully realized end-to-end teachable AI applications for accessibility. The app allows people who are blind or low vision to teach their phone to recognize personal objects —…
-
Exploring Object Status Recognition for Recipe Progress Tracking in Non-Visual Cooking
This paper presents OSCAR (Object Status Context Awareness for Recipes), a technical pipeline that uses object status recognition—tracking the condition and transformation of ingredients and tools—to support recipe progress tracking for blind and low…