Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
98 results found tagged multimodal interaction.
-
Dual Educational Electronic Textbooks: The Starlight Platform
This paper from the Foundation for Research and Technology-Hellas (FORTH) in Crete, Greece presents Starlight, a software platform for creating and reading multimodal interactive electronic textbooks that provide a Dual User Interface — an interface …
-
Designing Auditory Displays to Facilitate Object Localization in Virtual Haptic 3D Environments
This paper investigates five different auditory display designs to help blind users locate objects in a virtual haptic 3D environment explored with a PHANToM Desktop haptic device. While haptic devices give visually impaired users the ability to expl…
-
Multimodal User Input Patterns in a Non-Visual Context
This exploratory study from the New Jersey Institute of Technology investigates how users choose between speech and hand (touchpad) inputs when performing tasks in a non-visual interface. The research used AudioBrowser, a system that organizes inform…
-
Multimodal Virtual Reality Versus Printed Medium in Visualization for Blind People
This paper presents a comparative evaluation of two approaches for making bar chart data accessible to blind and visually impaired people: traditional raised tactile diagrams and a multimodal virtual reality system. The VR system combines a SensAble …
-
Auditory and Tactile Interfaces for Representing the Visual Effects on the Web
This paper from IBM Japan and Hokkaido University explores how blind users can perceive the visual structure and emphasis effects of web pages through auditory and tactile interfaces. The researchers identified a critical gap: modern web pages increa…
-
Multimodal Feedback: Establishing a Performance Baseline for Improved Access by Individuals with Visual Impairments
This study investigates how different combinations of auditory, haptic, and visual feedback affect the performance of fully sighted users during a complex direct manipulation task. The researchers designed the study as a baseline from which to later …
-
Zooming Interfaces! Enhancing the Performance of Eye Controlled Pointing Devices
This paper from De Montfort University quantifies the performance problems of eye-based pointing on standard graphical user interfaces and demonstrates that adding a zoom facility dramatically improves usability. The researchers identified three fund…
-
Expanded Interactions: Broadening Human-Centered Computing
This paper reports on the preliminary results of an NSF-sponsored invitational workshop titled "Expanded Interaction: Broadening Human-Centered Computing," held at the Winterthur Museum and A.I. duPont Institute in Wilmington, Delaware in May 1997. A…
-
Comparing Effects of Navigational Interface Modalities on Speaker Prosodics
This paper investigates whether speech-only (displayless) interfaces impose a measurable cognitive burden on users compared to multimodal interfaces that include visual or tactile components. The research uses an innovative methodology: rather than r…
-
Head Pointing and Speech Control as a Hands-Free Interface to Desktop Computing
This paper presents a hands-free computer interface that combines head pointing with speech control to enable users who cannot use a mouse and keyboard to operate standard WIMP-style graphical user interfaces. Developed at the Fraunhofer Institute in…