Literature Reviews
Reviewed research papers, articles, and publications relevant to digital accessibility.
22 results found tagged gesture recognition.
-
Brazilian Sign Language Multimedia Hangman Game: A Prototype of an Educational and Inclusive Application
This doctoral consortium paper presents a prototype educational game — a hangman game that uses Brazilian Sign Language (BSL/Libras) as its input method. Instead of typing letters on a keyboard, players perform fingerspelling signs from the Libras ma…
-
Kinempt: A Kinect-Based Prompting System to Transition Autonomously Through Vocational Tasks for Individuals with Cognitive Impairments
This short paper presents Kinempt (a portmanteau of "kinetic" and "prompt"), a Kinect-based task prompting system designed to help individuals with cognitive impairments perform vocational tasks independently. The research is motivated by the fact th…
-
Follow That Sound: Using Sonification and Corrective Verbal Feedback to Teach Touchscreen Gestures
This paper proposes and evaluates two techniques for teaching touchscreen gestures to users with visual impairments: gesture sonification (mapping finger position to audio using pitch for the y-axis and stereo panning for the x-axis) and corrective v…
-
Motor-Impaired Touchscreen Interactions in the Wild
This paper examines how touchscreen interaction performance varies over time for people with motor impairments, moving beyond snapshot lab studies to a four-week in-the-wild evaluation. Nine participants with conditions including Parkinson's disease,…
-
Sign Transition Modeling and a Scalable Solution to Continuous Sign Language Recognition for Real-World Applications
This paper presents a scalable framework for continuous sign language recognition (SLR) designed to work in real-world conditions using affordable hardware. The researchers address a fundamental challenge in SLR: modeling the transitions between sign…
-
Computer Vision-based Methodology to Support AAC
This paper presents a methodology for supporting augmentative and alternative communication (AAC) through personalized gestural interaction using computer vision and machine learning. The authors developed the PGCA (Personal Gesture Communication Ass…
-
Inclusive Improvisation: Exploring the Line between Listening and Playing Music
This paper explores how Digital Musical Instruments (DMIs) designed for professional performance can be adapted into Accessible Digital Musical Instruments (ADMIs) with minimal hardware and software changes. The authors present the AirSticks, a gestu…
-
Designing Spellcasters from Clinician Perspectives: A Customizable Gesture-Based Immersive Virtual Reality Game for Stroke Rehabilitation
This research presents Spellcasters, an immersive virtual reality game adapted from entertainment for stroke rehabilitation. More than 800,000 people suffer strokes annually in the US, with two-thirds requiring rehabilitation. Stroke survivors often …
-
Gesture-Based Interactive Audio Guide on Tactile Reliefs
This paper presents a gesture-controlled interactive audio guide (IAG) that operates directly on tactile relief surfaces using a low-cost depth camera (Intel RealSense F200). Tactile reliefs—2.5D "height field" representations where each point has a …
-
Pattern recognition and synthesis for sign language translation system
This paper describes a bidirectional sign language translation system being developed to translate between Japanese Sign Language (JSL) and written Japanese. The system addresses both directions of translation: recognizing sign language input and con…