Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
37 results found tagged sensory substitution.
-
Enhancing Caption Accessibility through Simultaneous Multimodal Information: Visual-Tactile Captions
This paper addresses a fundamental limitation of captions (subtitles) for deaf and hard of hearing (DHH) viewers: captions force viewers to split attention between reading text at the bottom of the screen and watching the visual action, inevitably ca…
-
VisAural: A Wearable Sound-Localisation Device for People with Impaired Hearing
This paper presents VisAural, a wearable device that converts sound direction information into visual cues for people with hearing impairments. The system addresses a gap left by conventional hearing aids, which help with general sound detection but …
-
Multimodal Perception of Histological Images for Persons Who Are Blind or Visually Impaired
This research addresses a critical barrier preventing blind or visually impaired (BVI) students and scientists from participating in STEM laboratory work: the inability to perceive real-time visual scientific data from instruments like light microsco…
-
Mathematical Content Browsing for Print-disabled Readers Based on Virtual-world Exploration and Audio-visual Sensory Substitution
This research addresses a critical accessibility gap: mathematical equations in PDF documents are largely inaccessible to blind and visually impaired readers. While standards like MathML exist for encoding accessible mathematics, most scientific and …
-
How Can Haptic Feedback Assist People with Blind and Low Vision (BLV): A Systematic Literature Review
This comprehensive systematic literature review examines 20 years (2004–2024) of research on haptic assistive tools for people who are blind or have low vision (BLV), analyzing 132 papers from 11 major HCI venues including CHI, ASSETS, UIST, and IEEE…
-
Sensory Substitution Training for Users Who Are Blind with Dynamic Stimuli, Games and Virtual Environments
This paper explores whether gamification and dynamic training can address one of the major barriers to sensory substitution device (SSD) adoption: the long, arduous learning process. SSDs like EyeMusic convert visual information into sound, enabling …
-
Ad-Hoc Access to Musical Sound for Deaf Individuals
This poster paper presents MuSS-Bits (Music Sensory Substitution Bits), a wearable sensor-display system that enables deaf individuals to explore musical sound from various audio sources with real-time vibrotactile feedback. While existing sensory su…
-
Using Dynamic Audio Feedback to Support Peripersonal Reaching in Young Visually Impaired People
This paper investigates whether dynamic audio feedback — sound that changes based on the proximity between a reaching hand and target objects — can improve the accuracy of peripersonal reaching (reaching within arm's length) for blind and visually im…
-
Participatory Design Using Sensory Substitution Devices with Tactile and Audio Feedback
This student research paper describes a participatory design study with a single blind participant (TC, blind from birth) to develop a sensory substitution device that provides a physical experience of spatial awareness through tactile or auditory fe…
-
Refreshable Braille Oral Appliance
This paper presents preliminary research toward developing a Refreshable Braille Oral Appliance (RBOA) — a refreshable Braille display embedded in an oral retainer that would allow users to read Braille with their tongue. The envisioned device connec…