Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
98 results found tagged multimodal interaction.
-
A Haptic Tool for Group Work on Geometrical Concepts Engaging Blind and Sighted Pupils
This study investigates how haptic technology can support collaborative geometry learning between visually impaired and sighted pupils in inclusive classrooms. The researchers developed two haptic applications using PHANTOM devices: a static environm…
-
Principles for Designing Large-Format Refreshable Haptic Graphics Using Touchscreen Devices: An Evaluation of Nonvisual Panning Methods
This paper addresses a fundamental challenge in touchscreen-based accessibility: how to provide non-visual access to large-format graphical materials like maps that exceed the device's screen size. While touchscreens represent the fastest-growing com…
-
Fast Human-Computer Interaction by Combining Gaze Pointing and Face Gestures
This paper presents FaceSwitch, an open-source multimodal accessibility system that combines eye gaze tracking for cursor positioning with facial gesture recognition for triggering actions. The system addresses limitations of existing gaze-based inte…
-
The Tangible Desktop: A Multimodal Approach to Nonvisual Computing
This paper identifies fundamental limitations of audio-only computer interfaces for blind and low-vision users and proposes a multimodal tangible alternative. The researchers conducted a 4-month field study at EmpowerTech, a computer training school …
-
Design Guidelines and Recommendations for Multimodal, Touchscreen-based Graphics
This paper presents comprehensive design guidelines for creating accessible graphics on touchscreen devices using vibration and audio feedback for people with visual impairments. Drawing on over eight years of research, the authors address a critical…
-
Design Guidelines for an Interactive 3D Model as a Supporting Tool for Exploring a Cultural Site by Visually Impaired and Sighted People
This paper presents a methodology for creating low-cost interactive 3D printed models combined with audio descriptions to enable both visually impaired and sighted people to explore cultural heritage sites autonomously. The prototype reproduces Piazz…
-
IMAGE: An Open-Source, Extensible Framework for Deploying Accessible Audio and Haptic Renderings of Web Graphics
This paper introduces IMAGE (Internet Multimodal Access to Graphical Exploration), an open-source software framework designed to help accessibility practitioners create and deploy audio and haptic representations of web graphics. The authors address …
-
Magic Touch: Interacting with 3D Printed Graphics
Magic Touch is a computer vision-based system that augments 3D printed tactile graphics with audio information, addressing a key limitation of physical models for blind users: while 3D printing can effectively convey shapes and textures, text annotat…
-
Comparing Tactile, Auditory, and Visual Assembly Error-Feedback for Workers with Cognitive Impairments
This paper compares three modalities of error feedback — tactile, auditory, and visual — for cognitively impaired workers performing manual assembly tasks at sheltered work organizations. Industrial manufacturing companies increasingly outsource asse…
-
CymaSense: A Novel Audio-Visual Therapeutic Tool for People on the Autism Spectrum
This paper presents CymaSense, an interactive multimodal tool that generates real-time 3D visual representations of sound based on Cymatics — the study of visible patterns created by sound vibrations in physical media like water or metal plates. The …