Literature Reviews

Reviewed research papers, articles, and publications relevant to digital accessibility.

• Color-Audio Encoding Interface for Visual Substitution: See ColOr Matlab-based Demo

  Juan Diego Gomez, Guido Bologna, Thierry Pun (2010) — Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010)

  This demonstration paper presents the See ColOr (Seeing Color with an Orchestra) system, a framework that translates colour information from images into spatialized musical instrument sounds to provide people who are blind with a form of colour perce…

  • sonification
  • visual substitution
  • blindness
  • color perception
  • sensory substitution
  • spatial audio
  • HRTF
  • assistive technology

• Toward 3D Scene Understanding via Audio-description: Kinect-iPad Fusion for the Visually Impaired

  Juan Diego Gomez, Sinan Mohammed, Guido Bologna, Thierry Pun (2011) — Proceedings of the 13th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2011)

  This demonstration paper presents a computer-vision-based framework that combines a Microsoft Kinect 3D depth sensor with an iPad touchscreen to enable visually impaired users to understand the spatial layout of indoor scenes through audio. The syste…

  • sonification
  • visual substitution
  • Kinect
  • computer vision
  • blindness
  • object recognition
  • spatial audio
  • tactile exploration
  • electronic travel aid
  • sensory substitution