Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
98 results found tagged multimodal interaction.
-
AudioFunctions.web: Multimodal Exploration of Mathematical Function Graphs
This full research paper presents AudioFunctions.web, a web application that enables blind and visually impaired people to explore mathematical function graphs through a combination of sonification, earcons, and speech synthesis. The system is the pl…
-
Multimodal Exploration of Mathematical Function Graphs with AudioFunctions.web
This demonstration paper presents AudioFunctions.web, a web-based system designed to make mathematical function graphs accessible to people who are blind or have visual impairments. Function graphs are a fundamental tool in mathematics education and …
-
Haptic and Auditive Mesh Inspection for Blind 3D Modelers
This paper presents an affordable audio-haptic system that enables blind and severely visually impaired people to independently inspect 3D mesh objects they create using constructive geometry programming languages like OpenSCAD. Blind 3D modelers typ…
-
AIGuide: An Augmented Reality Hand Guidance Application for People with Visual Impairments
This paper presents AIGuide, a self-contained offline iOS smartphone application that uses augmented reality (ARKit) to help people with visual impairments locate, navigate to, and pick up objects in their surroundings. Unlike existing object detecti…
-
Tapsonic: One Dimensional Finger Mounted Multimodal Line Chart Reader
This short paper presents Tapsonic, a finger-mounted wearable device that enables people with visual impairments to read line charts through a combination of haptic feedback and voiceover. The key innovation is a dimensionality reduction approach: ra…
-
CareHub: Smart Screen VUI and Home Appliances Control for Older Adults
This demonstration paper presents CareHub, a smart screen prototype that augments voice user interfaces (VUIs) with complementary visual output to help older adults control home appliances more effectively. The research was conducted at the Rhode Isl…
-
Multimodal 3D printed urban maps for blind people. Evaluations and scientific investigations
This poster paper presents a multimodal 3D printed urban map prototype that embeds capacitive touch sensors directly into the map body to provide location-specific audio descriptions when touched. The research, conducted at Wroclaw University of Scie…
-
Screen or No Screen? Lessons Learnt from a Real-World Deployment Study of Using Voice Assistants With and Without Touchscreen for Older Adults
This paper presents a 40-day within-subjects deployment study examining how older adults interact with voice assistants (VAs) with and without touchscreen capability. Sixteen participants (mean age 82.5 years), all living independently, used an Amazo…
-
Comparing Natural Language and Vibro-Audio Modalities for Inclusive STEM Learning with Blind and Low Vision Users
This study evaluates a multimodal touchscreen diagram system (MDS v 2.0) built on an iPhone that provides blind and low vision (BLV) users with two non-visual methods for accessing graphical STEM content: natural language (NL) descriptions delivered …
-
Developing and Deploying a Real-World Solution for Accessible Slide Reading and Authoring for Blind Users
This paper presents A11yBoard for Google Slides, a multi-device multimodal system that makes presentation slide reading and authoring accessible to blind users. Presentation software like PowerPoint and Google Slides relies on 2-D "artboard" canvases…