Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
37 results found tagged sensory substitution.
-
Detecting Objects and Obstacles for Visually Impaired Individuals Using Visual Saliency
This demo paper presents the detection module of See ColOr (Seeing Colors with an Orchestra), a mobility aid for visually impaired people developed at the University of Geneva. See ColOr transforms visual information from the environment into musical…
-
Color-Audio Encoding Interface for Visual Substitution: See ColOr Matlab-based Demo
This demonstration paper presents the See ColOr (Seeing Color with an Orchestra) system, a framework that translates colour information from images into spatialized musical instrument sounds to provide people who are blind with a form of colour perce…
-
Toward 3D Scene Understanding via Audio-description: Kinect-iPad Fusion for the Visually Impaired
This demonstration paper presents a computer-vision-based framework that combines a Microsoft Kinect 3D depth sensor with an iPad touchscreen to enable visually impaired users to understand the spatial layout of indoor scenes through audio. The syste…
-
Providing Haptic Feedback Using the Kinect
This poster paper presents a system that combines the Microsoft Kinect depth camera with a custom haptic glove to provide spatial awareness to people who are blind or visually impaired. The research addresses a gap in existing mobility aids: while ca…
-
FEPS: A Sensory Substitution System for the Blind to Perceive Facial Expressions
This demonstration paper presents FEPS (Facial Expression Perception through Sound), a visual-to-auditory sensory substitution system that enables blind individuals to perceive their conversation partner's facial expressions through sound. The inabil…
-
Do You See What I See? Designing a Sensory Substitution Device to Access Non-Verbal Modes of Communication
This paper presents iFEPS (improved Facial Expression Perception through Sound), a visual-to-auditory sensory substitution device that enables blind users to perceive their conversation partner's facial expressions through audio feedback. Research su…
-
M.I.D.A.S. Touch: Magnetic Interactive Device for Alternative Sight through Touch
This demonstration paper presents MIDAS Touch (Magnetic Interactive Device for Alternative Sight through Touch), a novel free-space haptic interface that allows visually impaired users to feel and create digital drawings without physical contact with…
-
Evaluation of Non-Visual Panning Operations Using Touch-Screen Devices
This demonstration paper addresses a critical challenge in non-visual access to graphical information on touchscreens: how to pan across large-format graphics (maps, floor plans) without losing spatial orientation. The authors built on their Vibro-Au…
-
Expression: A Google Glass Based Assistive Solution for Social Signal Processing
This demo paper presents Expression, a Google Glass-based assistive system that enables blind and visually impaired users to perceive non-verbal social signals during face-to-face conversations. Limited access to non-verbal cues — facial expressions,…
-
The Blind Driver Challenge: Steering Using Haptic Cues
This paper presents a haptic steering interface that enables blind individuals to steer a vehicle on a track using vibrotactile cues, addressing the National Federation of the Blind's 2004 "Blind Driver Challenge." While self-driving vehicles could t…