Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
98 results found tagged multimodal interaction.
-
Enhancing Scanning Input with Non-Speech Sounds
This paper proposes adding structured non-speech sounds (earcons) to scanning input systems used by people with severe motor disabilities who can only operate a single switch. Scanning input works by sequentially highlighting items in a grid; the use…
-
Multimodal Input for Computer Access and Augmentative Communication
This paper from the University of Delaware describes a research project exploring the integration of speech recognition with head-pointing as a multimodal input method for people with physical disabilities who cannot use standard keyboards and mice. …
-
Designing Interface Toolkit with Dynamic Selectable Modality
This paper presents the Fruit (Flexible and Rearrangeable User Interface Toolkit) system, an architecture for building user interfaces that allow dynamic switching between interaction modalities at runtime. The authors argue that the rigid coupling b…
-
Refreshable tactile graphics applied to schoolbook illustrations for students with visual impairment
This paper presents research on making schoolbook illustrations accessible to students with visual impairments using a refreshable tactile display system. The system combines the STReSS2 (Stimulator of Tactile Receptors by Skin Stretch), a device tha…
-
CATPro: context-aware task prompting system with multiple modalities for individuals with cognitive impairments
This short paper presents CATPro (Context-Aware Task Prompting), a system designed to help individuals with cognitive impairments perform daily living and workplace tasks more independently. The system targets people with a range of conditions includ…
-
Making Microsoft Excel Accessible: Multimodal Presentation of Charts
This paper presents a system for making Microsoft Excel charts accessible to people with visual impairments through a combination of haptic force feedback and audio cues. The authors identify that while screen readers and specialised tools can handle…
-
Instant Tactile-Audio Map: Enabling Access to Digital Maps for People with Visual Impairment
This paper presents an automated system for converting standard digital map images into interactive tactile-audio maps that people who are blind can explore independently. The core problem addressed is that while online map services like Google Maps …
-
Talking Points: The Differential Impact of Real-Time Computer Generated Audio/Visual Feedback on Speech-Like & Non-Speech-Like Vocalizations in Low Functioning Children with ASD
This paper examines whether real-time computer feedback systems (CFS) can differentially impact speech-like versus non-speech-like vocalizations in low-functioning children with Autism Spectrum Disorder. The distinction matters because the goal of sp…
-
Haptic User Interface Design for Students with Visual Impairments
This short paper explores the design of haptic user interfaces to help students with visual impairments understand science concepts related to heat and temperature — topics where common misconceptions are prevalent even among sighted students and whe…
-
Introducing Multimodal Paper-Digital Interfaces for Speech-Language Therapy
This paper explores how multimodal digital pen and paper technology can support speech-language therapy for adults with aphasia and apraxia of speech following stroke or brain injury. The researchers conducted five months of field observations with 1…