Note-Taker 2.0: The Next Step Toward Enabling Students who are Legally Blind to Take Notes in Class

Authors
David S. Hayden, Liqing Zhou, Michael J. Astrauskas, John A. Black
Year
2010
Publication
Proceedings of the 12th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2010)
DOI
10.1145/1878803.1878828
Standards Referenced
Americans with Disabilities Act

Summary

This paper describes the iterative design and usability testing of the Note-Taker, a portable assistive device that enables students who are legally blind to take notes during classroom lectures. The core problem is that note-taking requires rapidly switching between a far-sight task (viewing the board or projected slides) and a near-sight task (writing notes), creating what the authors call the Board-Note-Board (BNB) delay. Existing assistive technologies typically address only one of these tasks — monoculars for far-sight or magnifiers for near-sight — forcing low-vision students to spend significant time switching between devices. The Note-Taker solves this by combining a pan/tilt/zoom camera aimed at the front of the classroom with a digital notepad on a single Tablet PC display, eliminating the need to switch between near and far-sight devices. The paper traces the evolution from a proof-of-concept prototype (2007-2008) through Note-Taker 2.0, guided by nine design principles including portability, independence from classroom infrastructure, non-disruption of the classroom environment, and the BATE (Beyond Accessibility To Efficiency) principle — that the solution should let users access information as readily as sighted students. The 2.0 prototype features a custom-built PTZ camera with 36x zoom, titanium-geared servo motors, and touch-driven camera control using tap-to-center, touch-and-drag, and multitouch pinch-to-zoom gestures.

Key Findings

Usability testing with the proof-of-concept prototype involved two legally blind undergraduates over 3 months and 1 month respectively. The first student (D) used it for 150 hours and found it very beneficial despite camera droop and clunky directional controls. The second student (M) had a more mixed experience, partly due to unfamiliarity with Tablet PCs, but remained optimistic about the concept. Testing of the Note-Taker 2.0 PTZ camera with three legally blind students (visual acuities ranging from 20/30 to worse than 20/200) showed all three achieved an effective visual acuity of 20/10 — better than normal — when using the camera. Participants successfully read equations, located target words, read a periodic table, and scanned wide text across whiteboards. All three strongly agreed they would like to use the device in class. Key problems identified included: difficulty controlling zoom precisely (especially at high magnification), camera vibration/jitter during repositioning, and the lack of commercially available screen magnification software compatible with pen/stylus input — a critical gap for STEM students who need handwritten mathematical notation. Additional features include a "look-back" function (cached frames to see past occluded content), real-time histogram equalization and colour inversion for poor board contrast, and automatic file management organised by class and date.

Relevance to Practice

This paper addresses a significant gap in educational accessibility: the cognitive benefits of active note-taking (improved retention, focus, and processing) are well established in education research, yet students with low vision are effectively excluded from this learning activity. The alternatives mandated by the ADA — note-takers hired to copy notes, or lecture recording systems — make students passive recipients rather than active learners. The Note-Taker's design principles are broadly applicable to assistive technology design: the insistence on portability, independence from infrastructure, non-disruption of social interaction, and the BATE principle (matching rather than accommodating sighted users' efficiency) represent a mature design philosophy. The discovery that no commercial screen magnifier was compatible with pen/stylus input — despite Tablet PCs existing for over a decade — highlights how mainstream assistive technology can have blind spots that particularly affect specialised use cases like STEM education. For practitioners, the iterative user-centred design approach and detailed usability findings provide a model for developing complex assistive hardware/software systems.