Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
98 results found tagged multimodal interaction.
-
ChartA11y: Designing Accessible Touch Experiences of Visualizations with Blind Smartphone Users
This paper presents ChartA11y, an iOS mobile application that makes 2-D data visualizations accessible to blind and low-vision (BLV) smartphone users through multimodal touch interactions. Developed through an iterative participatory design process i…
-
A Recipe for Success? Exploring Strategies for Improving Non-Visual Access to Cooking Instructions
This paper investigates how people with vision impairments access and follow cooking recipes, identifying practices, challenges, and design opportunities for more accessible kitchen technologies. The researchers conducted semi-structured interviews w…
-
"We Musicians Know How to Divide and Conquer": Exploring Multimodal Interactions To Improve Music Reading and Memorization for Blind and Low Vision Learners
This paper investigates how multimodal assistive technologies (MATs) combining sound, vibration, and touch can improve music reading and memorization for blind or low-vision (BLV) musicians and learners. The study involved nine BLV participants from …
-
Designing Accessible Calendar Tools for Blind and Low-Vision Users
This extended abstract investigates the accessibility challenges blind and low vision (BLV) users face with calendar applications and explores how voice-activated personal assistants (VAPAs) like Siri and Alexa can enhance calendar usability. The stu…
-
GestureVoice: Enabling Multimodal Text Editing for Blind Users Using Gestures and Voice
This paper introduces GestureVoice, a multimodal text editing system that enables blind smartphone users to edit text using mid-air hand gestures detected by a smartwatch combined with voice commands, eliminating the need for touchscreen interaction.…
-
Investigating 'Touch and Talk' for Blind and Low Vision People: Science Communication Assistance Through Exploring Multiple Tactile Objects
This paper investigates how interactive dialogue and multiple tactile 3D models can enhance science communication for blind and low vision (BLV) users. The research addresses a gap in existing tactile learning tools: most Interactive 3D Models (I3Ms)…
-
Pictures in Your Mind: Using Interactive Gesture-Controlled Reliefs to Explore Art
This paper presents an interactive audio guide (IAG) system that combines 3D-printed tactile reliefs with gesture-controlled, location-dependent audio descriptions to make visual art accessible to blind, visually impaired, and cognitively disabled us…
-
MAIDR Meets AI: Exploring Multimodal LLM-Based Data Visualization Interpretation by and with Blind and Low-Vision Users
This paper investigates how blind and low-vision (BLV) users interact with large language models to interpret data visualizations, building on the authors' previously developed MAIDR (Multimodal Access and Interactive Data Representation) framework. …